[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:38:00 dist-test-slave-7lz4 krb5kdc[11016](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:38:00 dist-test-slave-7lz4 krb5kdc[11016](info): set up 2 sockets
Jun 19 06:38:00 dist-test-slave-7lz4 krb5kdc[11016](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260619 06:38:01.716729 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.058s user 0.011s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:38:01 dist-test-slave-7lz4 krb5kdc[11016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851081, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:38:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:38:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:38:01.896304 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:38835
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:38183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:38835
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:02.232949 11029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:02.233291 11029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:02.233479 11029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:02.241446 11029 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:38:02.241595 11029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:02.241689 11029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:02.241792 11029 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:38:02.241878 11029 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:38:02.252370 11029 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:38183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:38835
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:38835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:02.253873 11029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:02.255402 11029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:02.269560 11034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:02.269850 11029 server_base.cc:1034] running on GCE node
W20260619 06:38:02.269644 11037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:02.269589 11035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:02.271049 11029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:02.272781 11029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:02.274080 11029 hybrid_clock.cc:648] HybridClock initialized: now 1781851082274022 us; error 52 us; skew 500 ppm
I20260619 06:38:02.274497 11029 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:02 dist-test-slave-7lz4 krb5kdc[11016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851082, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:02.277938 11029 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:38:02.279567 11029 webserver.cc:460] Webserver started at http://127.10.192.126:42575/ using document root <none> and password file <none>
I20260619 06:38:02.280335 11029 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:02.280496 11029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:02.280848 11029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:02.284083 11029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "075f5f8dbc644acc8d2667e1ade1338a"
format_stamp: "Formatted at 2026-06-19 06:38:02 on dist-test-slave-7lz4"
server_key: "2b2b2dfaced04e679aa72058871c738a"
server_key_iv: "225c87c80c11fd0d36d377e50938a207"
server_key_version: "encryptionkey@0"
I20260619 06:38:02.284884 11029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "075f5f8dbc644acc8d2667e1ade1338a"
format_stamp: "Formatted at 2026-06-19 06:38:02 on dist-test-slave-7lz4"
server_key: "2b2b2dfaced04e679aa72058871c738a"
server_key_iv: "225c87c80c11fd0d36d377e50938a207"
server_key_version: "encryptionkey@0"
I20260619 06:38:02.290468 11029 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 06:38:02.294269 11044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:02.296007 11029 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260619 06:38:02.296211 11029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "075f5f8dbc644acc8d2667e1ade1338a"
format_stamp: "Formatted at 2026-06-19 06:38:02 on dist-test-slave-7lz4"
server_key: "2b2b2dfaced04e679aa72058871c738a"
server_key_iv: "225c87c80c11fd0d36d377e50938a207"
server_key_version: "encryptionkey@0"
I20260619 06:38:02.296434 11029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:02.312496 11029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:02.316838 11029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:02.317152 11029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:02.336532 11029 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:38835
I20260619 06:38:02.336544 11095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:38835 every 8 connection(s)
I20260619 06:38:02.338003 11029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:38:02.342044 11096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:02.344511 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 11029
I20260619 06:38:02.344856 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:38:02.347410 11009 external_mini_cluster.cc:1428] Setting key 010107d0e4fa644db08d0a72ad3659a0
I20260619 06:38:02.355964 11096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a: Bootstrap starting.
I20260619 06:38:02.359054 11096 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:02.360216 11096 log.cc:824] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:02.363672 11096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a: No bootstrap required, opened a new log
I20260619 06:38:02.373114 11096 raft_consensus.cc:348] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "075f5f8dbc644acc8d2667e1ade1338a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 38835 } }
I20260619 06:38:02.373692 11096 raft_consensus.cc:374] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:02.373828 11096 raft_consensus.cc:729] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 075f5f8dbc644acc8d2667e1ade1338a, State: Initialized, Role: FOLLOWER
I20260619 06:38:02.374624 11096 consensus_queue.cc:260] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "075f5f8dbc644acc8d2667e1ade1338a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 38835 } }
I20260619 06:38:02.374905 11096 raft_consensus.cc:388] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:38:02.375087 11096 raft_consensus.cc:482] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:38:02.375270 11096 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:02.377796 11096 raft_consensus.cc:504] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "075f5f8dbc644acc8d2667e1ade1338a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 38835 } }
I20260619 06:38:02.378428 11096 leader_election.cc:302] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 075f5f8dbc644acc8d2667e1ade1338a; no voters:
I20260619 06:38:02.379056 11096 leader_election.cc:288] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:38:02.379251 11101 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:02.380079 11101 raft_consensus.cc:686] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a [term 1 LEADER]: Becoming Leader. State: Replica: 075f5f8dbc644acc8d2667e1ade1338a, State: Running, Role: LEADER
I20260619 06:38:02.380776 11101 consensus_queue.cc:237] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "075f5f8dbc644acc8d2667e1ade1338a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 38835 } }
I20260619 06:38:02.381459 11096 sys_catalog.cc:564] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a [sys.catalog]: configured and running, proceeding with master startup.
Jun 19 06:38:02 dist-test-slave-7lz4 krb5kdc[11016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851081, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:02.386425 11102 sys_catalog.cc:455] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "075f5f8dbc644acc8d2667e1ade1338a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "075f5f8dbc644acc8d2667e1ade1338a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 38835 } } }
I20260619 06:38:02.386888 11102 sys_catalog.cc:458] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:02.388538 11103 sys_catalog.cc:455] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 075f5f8dbc644acc8d2667e1ade1338a. Latest consensus state: current_term: 1 leader_uuid: "075f5f8dbc644acc8d2667e1ade1338a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "075f5f8dbc644acc8d2667e1ade1338a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 38835 } } }
I20260619 06:38:02.388906 11103 sys_catalog.cc:458] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:02.392549 11108 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:38:02.398866 11108 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:38:02.404155 11098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:02.352535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58728 (local address 127.10.192.126:38835)
0619 06:38:02.353654 (+ 1119us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:02.353673 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:02.355052 (+ 1379us) server_negotiation.cc:407] Connection header received
0619 06:38:02.364883 (+ 9831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:02.364914 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:02.365481 (+ 567us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:02.366002 (+ 521us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:02.369093 (+ 3091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:02.371245 (+ 2152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:02.373215 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:02.374311 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:02.374532 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:02.387376 (+ 12844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:02.387391 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:02.387416 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:02.387480 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:02.394034 (+ 6554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:02.395895 (+ 1861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:02.395916 (+ 21us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:02.395930 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:02.396294 (+ 364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:02.397246 (+ 952us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:02.397255 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:02.397262 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:02.398317 (+ 1055us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:02.398811 (+ 494us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:02.401275 (+ 2464us) server_negotiation.cc:299] Negotiation successful
0619 06:38:02.401992 (+ 717us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":820,"thread_start_us":549,"threads_started":1}
I20260619 06:38:02.416640 11108 catalog_manager.cc:1347] Generated new cluster ID: 64b1839c466a49df9b45224ce28edf09
I20260619 06:38:02.416796 11108 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:38:02.436591 11108 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:38:02.437956 11108 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:38:02.444706 11108 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 075f5f8dbc644acc8d2667e1ade1338a: Generated new TSK 0
I20260619 06:38:02.445786 11108 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
I20260619 06:38:02.501324 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:38835
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:38183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:02.869894 11122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:02.870194 11122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:02.870292 11122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:02.877924 11122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:02.878140 11122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:02.878319 11122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:38:02.888803 11122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:38183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:38835
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:02.890198 11122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:02.891829 11122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:02.905396 11130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:02.905378 11128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:02.905583 11127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:02.906298 11122 server_base.cc:1034] running on GCE node
I20260619 06:38:02.906903 11122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:02.908094 11122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:02.909339 11122 hybrid_clock.cc:648] HybridClock initialized: now 1781851082909307 us; error 45 us; skew 500 ppm
I20260619 06:38:02.909690 11122 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:02 dist-test-slave-7lz4 krb5kdc[11016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851082, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:02.913074 11122 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:38:02.914636 11122 webserver.cc:460] Webserver started at http://127.10.192.65:44773/ using document root <none> and password file <none>
I20260619 06:38:02.915340 11122 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:02.915472 11122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:02.915895 11122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:02.918783 11122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "f5a9497783c44f7184fba45dd001df79"
format_stamp: "Formatted at 2026-06-19 06:38:02 on dist-test-slave-7lz4"
server_key: "7787fb05a0087c6041cb5298e658901d"
server_key_iv: "1ad53f1fda054bb1722c9fedd641110b"
server_key_version: "encryptionkey@0"
I20260619 06:38:02.919480 11122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "f5a9497783c44f7184fba45dd001df79"
format_stamp: "Formatted at 2026-06-19 06:38:02 on dist-test-slave-7lz4"
server_key: "7787fb05a0087c6041cb5298e658901d"
server_key_iv: "1ad53f1fda054bb1722c9fedd641110b"
server_key_version: "encryptionkey@0"
I20260619 06:38:02.924604 11122 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.002s
I20260619 06:38:02.927995 11137 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:02.929541 11122 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:38:02.929733 11122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "f5a9497783c44f7184fba45dd001df79"
format_stamp: "Formatted at 2026-06-19 06:38:02 on dist-test-slave-7lz4"
server_key: "7787fb05a0087c6041cb5298e658901d"
server_key_iv: "1ad53f1fda054bb1722c9fedd641110b"
server_key_version: "encryptionkey@0"
I20260619 06:38:02.929957 11122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:02.946496 11122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:02.951088 11122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:02.951408 11122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:02.952510 11122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:02.953850 11122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:02.953963 11122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:02.954107 11122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:02.954181 11122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:02.987816 11122 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:36109
I20260619 06:38:02.987867 11249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:36109 every 8 connection(s)
I20260619 06:38:02.989228 11122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:38:02.992692 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 11122
I20260619 06:38:02.992944 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:38:02.993742 11009 external_mini_cluster.cc:1428] Setting key 5dadd12f8a22564a6be178b2cc72ba37
Jun 19 06:38:03 dist-test-slave-7lz4 krb5kdc[11016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851082, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.192.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.66@KRBTEST.COM" created.
I20260619 06:38:03.014273 11252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:02.991914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:47371 (local address 127.10.192.126:38835)
0619 06:38:02.992482 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:02.992489 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:02.993964 (+ 1475us) server_negotiation.cc:407] Connection header received
0619 06:38:02.996224 (+ 2260us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:02.996231 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:02.996313 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:02.996440 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:02.998303 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:02.999463 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:03.002089 (+ 2626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:03.002514 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:03.002619 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:03.007403 (+ 4784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:03.007410 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:03.007413 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:03.007453 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:03.010492 (+ 3039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:03.011335 (+ 843us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:03.011344 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:03.011354 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:03.011539 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:03.012098 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:03.012104 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:03.012107 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:03.012490 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:03.012657 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:03.013561 (+ 904us) server_negotiation.cc:299] Negotiation successful
0619 06:38:03.013817 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":263,"threads_started":1}
I20260619 06:38:03.015350 11253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:02.992781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:38835 (local address 127.10.192.65:47371)
0619 06:38:02.993770 (+ 989us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:02.993818 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:02.995939 (+ 2121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:02.996696 (+ 757us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:02.996705 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:02.997485 (+ 780us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:02.998114 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:02.998134 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:02.999626 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:02.999680 (+ 54us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:03.001928 (+ 2248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:03.001949 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:03.002766 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:03.002776 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:03.003150 (+ 374us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:03.004034 (+ 884us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:03.004070 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:03.007103 (+ 3033us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:03.010662 (+ 3559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:03.010673 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:03.010692 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:03.011171 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:03.011727 (+ 556us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:03.011734 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:03.011737 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:03.011962 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:03.012630 (+ 668us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:03.012639 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:03.013092 (+ 453us) client_negotiation.cc:769] Sending connection context
0619 06:38:03.013448 (+ 356us) client_negotiation.cc:240] Negotiation successful
0619 06:38:03.014030 (+ 582us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"thread_start_us":417,"threads_started":1}
I20260619 06:38:03.017205 11250 heartbeater.cc:347] Connected to a master server at 127.10.192.126:38835
I20260619 06:38:03.017562 11250 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:03.018411 11250 heartbeater.cc:511] Master 127.10.192.126:38835 requested a full tablet report, sending...
I20260619 06:38:03.020697 11061 ts_manager.cc:194] Registered new tserver with Master: f5a9497783c44f7184fba45dd001df79 (127.10.192.65:36109)
I20260619 06:38:03.022274 11061 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:47371
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
I20260619 06:38:03.035719 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:38835
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:38183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:03.359886 11256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:03.360167 11256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:03.360265 11256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:03.367512 11256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:03.367658 11256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:03.367853 11256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:38:03.377743 11256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:38183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:38835
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:03.379128 11256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:03.380601 11256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:03.394352 11262 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:03.394394 11264 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:03.394994 11261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:03.397305 11256 server_base.cc:1034] running on GCE node
I20260619 06:38:03.398068 11256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:03.399049 11256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:03.400285 11256 hybrid_clock.cc:648] HybridClock initialized: now 1781851083400215 us; error 60 us; skew 500 ppm
I20260619 06:38:03.400681 11256 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:03 dist-test-slave-7lz4 krb5kdc[11016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851083, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:03.403983 11256 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:38:03.405592 11256 webserver.cc:460] Webserver started at http://127.10.192.66:46625/ using document root <none> and password file <none>
I20260619 06:38:03.406328 11256 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:03.406476 11256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:03.406807 11256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:03.409842 11256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "112e13d11cf2433a9d2e1c7b44ee2b82"
format_stamp: "Formatted at 2026-06-19 06:38:03 on dist-test-slave-7lz4"
server_key: "90463e13ce590d745a2fa80214879fcb"
server_key_iv: "fdedd198e6988cd666f53778d1f1f6b1"
server_key_version: "encryptionkey@0"
I20260619 06:38:03.410622 11256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "112e13d11cf2433a9d2e1c7b44ee2b82"
format_stamp: "Formatted at 2026-06-19 06:38:03 on dist-test-slave-7lz4"
server_key: "90463e13ce590d745a2fa80214879fcb"
server_key_iv: "fdedd198e6988cd666f53778d1f1f6b1"
server_key_version: "encryptionkey@0"
I20260619 06:38:03.416011 11256 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260619 06:38:03.419502 11271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:03.420907 11256 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:38:03.421088 11256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "112e13d11cf2433a9d2e1c7b44ee2b82"
format_stamp: "Formatted at 2026-06-19 06:38:03 on dist-test-slave-7lz4"
server_key: "90463e13ce590d745a2fa80214879fcb"
server_key_iv: "fdedd198e6988cd666f53778d1f1f6b1"
server_key_version: "encryptionkey@0"
I20260619 06:38:03.421309 11256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:03.438813 11256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:03.442824 11256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:03.443130 11256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:03.444201 11256 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:03.445593 11256 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:03.445698 11256 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:03.445847 11256 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:03.445920 11256 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:03.479571 11256 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:39229
I20260619 06:38:03.479617 11383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:39229 every 8 connection(s)
I20260619 06:38:03.480901 11256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:38:03.483330 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 11256
I20260619 06:38:03.483510 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:38:03.484017 11009 external_mini_cluster.cc:1428] Setting key ba6c1439e473275e700582283eadb5e1
Jun 19 06:38:03 dist-test-slave-7lz4 krb5kdc[11016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851083, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.192.67@KRBTEST.COM; defaulting to no policy
I20260619 06:38:03.503295 11252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:03.483533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:47313 (local address 127.10.192.126:38835)
0619 06:38:03.483770 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:03.483778 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:03.485134 (+ 1356us) server_negotiation.cc:407] Connection header received
0619 06:38:03.487024 (+ 1890us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:03.487030 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:03.487125 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:03.487233 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:03.488849 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:03.489551 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:03.491840 (+ 2289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:03.492303 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:03.492419 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:03.497330 (+ 4911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:03.497335 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:03.497339 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:03.497373 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:03.500211 (+ 2838us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:03.501063 (+ 852us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:03.501069 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:03.501074 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:03.501232 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:03.501717 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:03.501721 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:03.501723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:03.502005 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:03.502117 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:03.502820 (+ 703us) server_negotiation.cc:299] Negotiation successful
0619 06:38:03.503009 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260619 06:38:03.504431 11386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:03.484135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:38835 (local address 127.10.192.66:47313)
0619 06:38:03.484966 (+ 831us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:03.485020 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:03.486728 (+ 1708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:03.487490 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:03.487499 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:03.488089 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:03.488666 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:03.488690 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:03.489720 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:03.489724 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:03.491691 (+ 1967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:03.491709 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:03.492562 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:03.492572 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:03.492951 (+ 379us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:03.493758 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:03.493798 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:03.497039 (+ 3241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:03.500407 (+ 3368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:03.500418 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:03.500438 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:03.500930 (+ 492us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:03.501416 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:03.501419 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:03.501422 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:03.501612 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:03.502113 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:03.502119 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:03.502498 (+ 379us) client_negotiation.cc:769] Sending connection context
0619 06:38:03.502730 (+ 232us) client_negotiation.cc:240] Negotiation successful
0619 06:38:03.503127 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":542,"thread_start_us":348,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.67@KRBTEST.COM" created.
I20260619 06:38:03.505971 11384 heartbeater.cc:347] Connected to a master server at 127.10.192.126:38835
I20260619 06:38:03.506305 11384 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:03.507288 11384 heartbeater.cc:511] Master 127.10.192.126:38835 requested a full tablet report, sending...
I20260619 06:38:03.509130 11061 ts_manager.cc:194] Registered new tserver with Master: 112e13d11cf2433a9d2e1c7b44ee2b82 (127.10.192.66:39229)
I20260619 06:38:03.509939 11061 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:47313
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
I20260619 06:38:03.527117 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:38835
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:38183
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:03.861577 11389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:03.861889 11389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:03.862066 11389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:03.869418 11389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:03.869540 11389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:03.869740 11389 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:38:03.879848 11389 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:38183
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:38835
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:03.881238 11389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:03.882718 11389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:03.896263 11397 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:03.896274 11394 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:03.896296 11395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:03.897235 11389 server_base.cc:1034] running on GCE node
I20260619 06:38:03.897996 11389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:03.899114 11389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:03.900359 11389 hybrid_clock.cc:648] HybridClock initialized: now 1781851083900252 us; error 63 us; skew 500 ppm
I20260619 06:38:03.900756 11389 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:03 dist-test-slave-7lz4 krb5kdc[11016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851083, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:03.904683 11389 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:38:03.906332 11389 webserver.cc:460] Webserver started at http://127.10.192.67:44453/ using document root <none> and password file <none>
I20260619 06:38:03.907078 11389 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:03.907210 11389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:03.907560 11389 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:03.910742 11389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "c0520ba92f3e4b9fbb3ab5bf07aaf33d"
format_stamp: "Formatted at 2026-06-19 06:38:03 on dist-test-slave-7lz4"
server_key: "9c648b63d3bcc1207a32ae583272b390"
server_key_iv: "a09827ddcbfd64568912a63b0ff36083"
server_key_version: "encryptionkey@0"
I20260619 06:38:03.911545 11389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "c0520ba92f3e4b9fbb3ab5bf07aaf33d"
format_stamp: "Formatted at 2026-06-19 06:38:03 on dist-test-slave-7lz4"
server_key: "9c648b63d3bcc1207a32ae583272b390"
server_key_iv: "a09827ddcbfd64568912a63b0ff36083"
server_key_version: "encryptionkey@0"
I20260619 06:38:03.917053 11389 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260619 06:38:03.921298 11404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:03.923393 11389 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260619 06:38:03.923674 11389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "c0520ba92f3e4b9fbb3ab5bf07aaf33d"
format_stamp: "Formatted at 2026-06-19 06:38:03 on dist-test-slave-7lz4"
server_key: "9c648b63d3bcc1207a32ae583272b390"
server_key_iv: "a09827ddcbfd64568912a63b0ff36083"
server_key_version: "encryptionkey@0"
I20260619 06:38:03.923971 11389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:03.946764 11389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:03.950906 11389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:03.951162 11389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:03.952292 11389 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:03.953982 11389 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:03.954090 11389 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:03.954222 11389 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:03.954294 11389 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:03.988526 11389 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:41047
I20260619 06:38:03.988641 11516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:41047 every 8 connection(s)
I20260619 06:38:03.989872 11389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:38:03.994239 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 11389
I20260619 06:38:03.994437 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:38:03.994941 11009 external_mini_cluster.cc:1428] Setting key b64ea149f996eb0a50188472185899ba
Jun 19 06:38:04 dist-test-slave-7lz4 krb5kdc[11016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851083, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:04.011794 11252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:03.992965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:41225 (local address 127.10.192.126:38835)
0619 06:38:03.993173 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:03.993179 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:03.994567 (+ 1388us) server_negotiation.cc:407] Connection header received
0619 06:38:03.996684 (+ 2117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:03.996690 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:03.996808 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:03.996934 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:03.998629 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:03.999470 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:04.001152 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:04.001594 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:04.001749 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:04.005433 (+ 3684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:04.005446 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:04.005450 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:04.005485 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:04.008430 (+ 2945us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:04.009286 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:04.009295 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:04.009298 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:04.009450 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:04.009924 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:04.009928 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:04.009930 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:04.010217 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:04.010394 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:04.011158 (+ 764us) server_negotiation.cc:299] Negotiation successful
0619 06:38:04.011392 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260619 06:38:04.012814 11519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:03.993464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:38835 (local address 127.10.192.67:41225)
0619 06:38:03.994322 (+ 858us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:03.994370 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:03.996375 (+ 2005us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:03.997172 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:03.997205 (+ 33us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:03.997795 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:03.998469 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:03.998487 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:03.999618 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:03.999624 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:04.001004 (+ 1380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:04.001017 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:04.001817 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:04.001828 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:04.002095 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:04.002868 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:04.002893 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:04.005190 (+ 2297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:04.008595 (+ 3405us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:04.008605 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:04.008632 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:04.009095 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:04.009580 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:04.009585 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:04.009589 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:04.009786 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:04.010353 (+ 567us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:04.010363 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:04.010780 (+ 417us) client_negotiation.cc:769] Sending connection context
0619 06:38:04.011061 (+ 281us) client_negotiation.cc:240] Negotiation successful
0619 06:38:04.011678 (+ 617us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":299,"threads_started":1}
I20260619 06:38:04.014196 11517 heartbeater.cc:347] Connected to a master server at 127.10.192.126:38835
I20260619 06:38:04.014488 11517 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:04.015143 11517 heartbeater.cc:511] Master 127.10.192.126:38835 requested a full tablet report, sending...
I20260619 06:38:04.016633 11061 ts_manager.cc:194] Registered new tserver with Master: c0520ba92f3e4b9fbb3ab5bf07aaf33d (127.10.192.67:41047)
I20260619 06:38:04.017410 11061 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:41225
I20260619 06:38:04.023564 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 06:38:04.025523 11250 heartbeater.cc:503] Master 127.10.192.126:38835 was elected leader, sending a full tablet report...
Jun 19 06:38:04 dist-test-slave-7lz4 krb5kdc[11016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851084, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 19 06:38:04 dist-test-slave-7lz4 krb5kdc[11016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851084, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:38:04.069209 11524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:04.053673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52672 (local address 127.10.192.65:36109)
0619 06:38:04.054360 (+ 687us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:04.054367 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:04.054419 (+ 52us) server_negotiation.cc:407] Connection header received
0619 06:38:04.054491 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:04.054498 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:04.054728 (+ 230us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:04.054856 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:04.056454 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:04.057467 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:04.058765 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:04.059325 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:04.059423 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:04.063496 (+ 4073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:04.063510 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:04.063526 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:04.063562 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:04.066595 (+ 3033us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:04.067222 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:04.067229 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:04.067231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:04.067351 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:04.067746 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:04.067749 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:04.067751 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:04.068105 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:04.068334 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:04.068584 (+ 250us) server_negotiation.cc:299] Negotiation successful
0619 06:38:04.068823 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":387,"threads_started":1}
W20260619 06:38:04.070672 11165 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52672
Jun 19 06:38:04 dist-test-slave-7lz4 krb5kdc[11016](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 19 06:38:04 dist-test-slave-7lz4 krb5kdc[11016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:38:04.115231 11524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:04.101636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52676 (local address 127.10.192.65:36109)
0619 06:38:04.101869 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:04.101876 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:04.102092 (+ 216us) server_negotiation.cc:407] Connection header received
0619 06:38:04.102250 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:04.102254 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:04.102323 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:04.102413 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:04.103810 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:04.104497 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:04.105738 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:04.106173 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:04.106268 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:04.110394 (+ 4126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:04.110399 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:04.110403 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:04.110443 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:04.112979 (+ 2536us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:04.113602 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:04.113606 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:04.113608 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:04.113726 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:04.114036 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:04.114040 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:04.114042 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:04.114287 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:04.114468 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:04.114728 (+ 260us) server_negotiation.cc:299] Negotiation successful
0619 06:38:04.114889 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260619 06:38:04.116907 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 11122
I20260619 06:38:04.130291 11524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:04.118036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52684 (local address 127.10.192.65:36109)
0619 06:38:04.118206 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:04.118210 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:04.118492 (+ 282us) server_negotiation.cc:407] Connection header received
0619 06:38:04.118619 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:04.118622 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:04.118678 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:04.118762 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:04.119969 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:04.120689 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:04.121909 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:04.122336 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:04.122431 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:04.124877 (+ 2446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:04.124882 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:04.124885 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:04.124916 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:04.127577 (+ 2661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:04.128349 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:04.128354 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:04.128356 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:04.128506 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:04.128942 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:04.128946 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:04.128948 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:04.129220 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:04.129409 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:04.129687 (+ 278us) server_negotiation.cc:299] Negotiation successful
0619 06:38:04.129852 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260619 06:38:04.131031 11245 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:04.215292 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 11122
I20260619 06:38:04.231554 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 11256
Jun 19 06:38:04 dist-test-slave-7lz4 krb5kdc[11016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.66@KRBTEST.COM
I20260619 06:38:04.248189 11531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:04.232524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48690 (local address 127.10.192.66:39229)
0619 06:38:04.233097 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:04.233104 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:04.233127 (+ 23us) server_negotiation.cc:407] Connection header received
0619 06:38:04.233192 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:04.233198 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:04.233409 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:04.233542 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:04.234659 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:04.235824 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:04.237114 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:04.237679 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:04.237779 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:04.241987 (+ 4208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:04.241999 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:04.242022 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:04.242057 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:04.245152 (+ 3095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:04.245907 (+ 755us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:04.245916 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:04.245918 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:04.246054 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:04.246489 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:04.246495 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:04.246498 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:04.246852 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:04.247190 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:04.247501 (+ 311us) server_negotiation.cc:299] Negotiation successful
0619 06:38:04.247798 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":323,"threads_started":1}
I20260619 06:38:04.249558 11379 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:04.335060 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 11256
I20260619 06:38:04.355191 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 11389
Jun 19 06:38:04 dist-test-slave-7lz4 krb5kdc[11016](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851084, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.67@KRBTEST.COM
I20260619 06:38:04.371915 11533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:04.356403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38230 (local address 127.10.192.67:41047)
0619 06:38:04.357063 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:04.357070 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:04.357097 (+ 27us) server_negotiation.cc:407] Connection header received
0619 06:38:04.357156 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:04.357163 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:04.357375 (+ 212us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:04.357554 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:04.358865 (+ 1311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:04.359997 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:04.361284 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:04.361848 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:04.362018 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:04.366338 (+ 4320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:04.366350 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:04.366364 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:04.366405 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:04.369288 (+ 2883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:04.369986 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:04.369993 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:04.369996 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:04.370117 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:04.370443 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:04.370448 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:04.370449 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:04.370788 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:04.371033 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:04.371270 (+ 237us) server_negotiation.cc:299] Negotiation successful
0619 06:38:04.371495 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":348,"threads_started":1}
I20260619 06:38:04.373234 11512 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:04.457135 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 11389
I20260619 06:38:04.472980 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 11029
I20260619 06:38:04.474253 11091 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:04.577921 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 11029
2026-06-19T06:38:04Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (3970 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:38:04 dist-test-slave-7lz4 krb5kdc[11538](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:38:04 dist-test-slave-7lz4 krb5kdc[11538](info): set up 2 sockets
Jun 19 06:38:04 dist-test-slave-7lz4 krb5kdc[11538](info): commencing operation
krb5kdc: starting...
W20260619 06:38:05.660094 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.000s sys 0.014s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:38:05 dist-test-slave-7lz4 krb5kdc[11538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:38:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:38:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:38:05.843353 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:34329
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:33281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:34329
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:06.170670 11551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:06.170990 11551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:06.171154 11551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:06.178501 11551 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:38:06.178623 11551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:06.178709 11551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:06.178823 11551 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:38:06.178921 11551 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:38:06.189038 11551 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:33281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:34329
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:34329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:06.190464 11551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:06.191835 11551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:06.203685 11557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:06.203820 11556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:06.203783 11559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:06.204820 11551 server_base.cc:1034] running on GCE node
I20260619 06:38:06.205642 11551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:06.207448 11551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:06.208659 11551 hybrid_clock.cc:648] HybridClock initialized: now 1781851086208599 us; error 87 us; skew 500 ppm
I20260619 06:38:06.209048 11551 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:06 dist-test-slave-7lz4 krb5kdc[11538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851086, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:06.215617 11551 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:38:06.217319 11551 webserver.cc:460] Webserver started at http://127.10.192.126:34571/ using document root <none> and password file <none>
I20260619 06:38:06.218091 11551 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:06.218248 11551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:06.218580 11551 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:06.221707 11551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "973d3a608b0541278e879ff2cbd1f52f"
format_stamp: "Formatted at 2026-06-19 06:38:06 on dist-test-slave-7lz4"
server_key: "7e427158bc7fcc9f392e29426c195eda"
server_key_iv: "7b2d5b379e7c4eee81b48c9c0c86aef8"
server_key_version: "encryptionkey@0"
I20260619 06:38:06.222477 11551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "973d3a608b0541278e879ff2cbd1f52f"
format_stamp: "Formatted at 2026-06-19 06:38:06 on dist-test-slave-7lz4"
server_key: "7e427158bc7fcc9f392e29426c195eda"
server_key_iv: "7b2d5b379e7c4eee81b48c9c0c86aef8"
server_key_version: "encryptionkey@0"
I20260619 06:38:06.227895 11551 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260619 06:38:06.231424 11566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:06.232892 11551 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:38:06.233093 11551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "973d3a608b0541278e879ff2cbd1f52f"
format_stamp: "Formatted at 2026-06-19 06:38:06 on dist-test-slave-7lz4"
server_key: "7e427158bc7fcc9f392e29426c195eda"
server_key_iv: "7b2d5b379e7c4eee81b48c9c0c86aef8"
server_key_version: "encryptionkey@0"
I20260619 06:38:06.233309 11551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:06.249939 11551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:06.254753 11551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:06.255059 11551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:06.274677 11551 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:34329
I20260619 06:38:06.274718 11617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:34329 every 8 connection(s)
I20260619 06:38:06.276391 11551 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:38:06.280441 11618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:06.281296 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 11551
I20260619 06:38:06.281553 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:38:06.282217 11009 external_mini_cluster.cc:1428] Setting key 54685b729655e6b513040368463374f0
I20260619 06:38:06.295677 11618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f: Bootstrap starting.
Jun 19 06:38:06 dist-test-slave-7lz4 krb5kdc[11538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:06.299341 11618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:06.300800 11618 log.cc:824] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:06.304450 11618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f: No bootstrap required, opened a new log
I20260619 06:38:06.308485 11621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:06.284373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51902 (local address 127.10.192.126:34329)
0619 06:38:06.285216 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:06.285238 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:06.285294 (+ 56us) server_negotiation.cc:407] Connection header received
0619 06:38:06.287391 (+ 2097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:06.287424 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:06.288087 (+ 663us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:06.288618 (+ 531us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:06.290043 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:06.292158 (+ 2115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:06.293504 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:06.294635 (+ 1131us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:06.294824 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:06.299350 (+ 4526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:06.299363 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:06.299396 (+ 33us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:06.299455 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:06.303421 (+ 3966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:06.304246 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:06.304254 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:06.304264 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:06.304486 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:06.304912 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:06.304919 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:06.304923 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:06.305707 (+ 784us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:06.306011 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:06.306438 (+ 427us) server_negotiation.cc:299] Negotiation successful
0619 06:38:06.306923 (+ 485us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":317,"threads_started":1}
I20260619 06:38:06.313645 11618 raft_consensus.cc:348] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "973d3a608b0541278e879ff2cbd1f52f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34329 } }
I20260619 06:38:06.314087 11618 raft_consensus.cc:374] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:06.314195 11618 raft_consensus.cc:729] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 973d3a608b0541278e879ff2cbd1f52f, State: Initialized, Role: FOLLOWER
I20260619 06:38:06.314860 11618 consensus_queue.cc:260] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "973d3a608b0541278e879ff2cbd1f52f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34329 } }
I20260619 06:38:06.315152 11618 raft_consensus.cc:388] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:38:06.315263 11618 raft_consensus.cc:482] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:38:06.315388 11618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:06.317521 11618 raft_consensus.cc:504] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "973d3a608b0541278e879ff2cbd1f52f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34329 } }
I20260619 06:38:06.317975 11618 leader_election.cc:302] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 973d3a608b0541278e879ff2cbd1f52f; no voters:
I20260619 06:38:06.318558 11618 leader_election.cc:288] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:38:06.318739 11623 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:06.319473 11623 raft_consensus.cc:686] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f [term 1 LEADER]: Becoming Leader. State: Replica: 973d3a608b0541278e879ff2cbd1f52f, State: Running, Role: LEADER
I20260619 06:38:06.320361 11623 consensus_queue.cc:237] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "973d3a608b0541278e879ff2cbd1f52f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34329 } }
I20260619 06:38:06.320796 11618 sys_catalog.cc:564] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:38:06.323124 11624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "973d3a608b0541278e879ff2cbd1f52f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "973d3a608b0541278e879ff2cbd1f52f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34329 } } }
I20260619 06:38:06.323464 11624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:06.323853 11625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 973d3a608b0541278e879ff2cbd1f52f. Latest consensus state: current_term: 1 leader_uuid: "973d3a608b0541278e879ff2cbd1f52f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "973d3a608b0541278e879ff2cbd1f52f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34329 } } }
I20260619 06:38:06.324222 11625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:06.326189 11630 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:38:06.332113 11630 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:38:06.341905 11630 catalog_manager.cc:1347] Generated new cluster ID: 5aefc6ebbf2b42c3be8eebf878b3b6a6
I20260619 06:38:06.342058 11630 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:38:06.354027 11630 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:38:06.356153 11630 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:38:06.369195 11630 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 973d3a608b0541278e879ff2cbd1f52f: Generated new TSK 0
I20260619 06:38:06.370417 11630 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
I20260619 06:38:06.418893 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:34329
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:33281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:06.786887 11644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:06.787257 11644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:06.787439 11644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:06.794941 11644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:06.795137 11644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:06.795342 11644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:38:06.805876 11644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:33281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:34329
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:06.807680 11644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:06.809118 11644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:06.823105 11650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:06.823450 11652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:06.823143 11649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:06.824227 11644 server_base.cc:1034] running on GCE node
I20260619 06:38:06.824891 11644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:06.826152 11644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:06.827399 11644 hybrid_clock.cc:648] HybridClock initialized: now 1781851086827329 us; error 63 us; skew 500 ppm
I20260619 06:38:06.827808 11644 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:06 dist-test-slave-7lz4 krb5kdc[11538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851086, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:06.830929 11644 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:38:06.832476 11644 webserver.cc:460] Webserver started at http://127.10.192.65:40063/ using document root <none> and password file <none>
I20260619 06:38:06.833192 11644 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:06.833345 11644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:06.833750 11644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:06.836838 11644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "76943d46c7ef40eab95c667d75b4a60f"
format_stamp: "Formatted at 2026-06-19 06:38:06 on dist-test-slave-7lz4"
server_key: "10fd7961165be769a43f740c26b63255"
server_key_iv: "0caafddd2798bb09bd26db81c651b610"
server_key_version: "encryptionkey@0"
I20260619 06:38:06.837726 11644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "76943d46c7ef40eab95c667d75b4a60f"
format_stamp: "Formatted at 2026-06-19 06:38:06 on dist-test-slave-7lz4"
server_key: "10fd7961165be769a43f740c26b63255"
server_key_iv: "0caafddd2798bb09bd26db81c651b610"
server_key_version: "encryptionkey@0"
I20260619 06:38:06.843114 11644 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 06:38:06.846747 11659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:06.848265 11644 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:38:06.848464 11644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "76943d46c7ef40eab95c667d75b4a60f"
format_stamp: "Formatted at 2026-06-19 06:38:06 on dist-test-slave-7lz4"
server_key: "10fd7961165be769a43f740c26b63255"
server_key_iv: "0caafddd2798bb09bd26db81c651b610"
server_key_version: "encryptionkey@0"
I20260619 06:38:06.848687 11644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:06.874963 11644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:06.879371 11644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:06.879755 11644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:06.880772 11644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:06.882251 11644 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:06.882364 11644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:06.882519 11644 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:06.882591 11644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:06.917044 11644 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:46803
I20260619 06:38:06.917091 11771 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:46803 every 8 connection(s)
I20260619 06:38:06.918470 11644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:38:06.920301 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 11644
I20260619 06:38:06.920539 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:38:06.921357 11009 external_mini_cluster.cc:1428] Setting key 3ad7534b3c71cd438e155e260c9c187f
Jun 19 06:38:06 dist-test-slave-7lz4 krb5kdc[11538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851086, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.192.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.66@KRBTEST.COM" created.
I20260619 06:38:06.943008 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:06.921495 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:58609 (local address 127.10.192.126:34329)
0619 06:38:06.922077 (+ 582us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:06.922083 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:06.923306 (+ 1223us) server_negotiation.cc:407] Connection header received
0619 06:38:06.926262 (+ 2956us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:06.926268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:06.926352 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:06.926500 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:06.928843 (+ 2343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:06.930060 (+ 1217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:06.931735 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:06.932510 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:06.932663 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:06.936528 (+ 3865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:06.936533 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:06.936537 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:06.936571 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:06.939342 (+ 2771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:06.940348 (+ 1006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:06.940360 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:06.940363 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:06.940518 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:06.941101 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:06.941105 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:06.941107 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:06.941475 (+ 368us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:06.941639 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:06.942392 (+ 753us) server_negotiation.cc:299] Negotiation successful
0619 06:38:06.942638 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":384,"thread_start_us":250,"threads_started":1}
I20260619 06:38:06.944142 11775 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:06.922209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:34329 (local address 127.10.192.65:58609)
0619 06:38:06.922986 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:06.923035 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:06.925873 (+ 2838us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:06.926811 (+ 938us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:06.926828 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:06.927706 (+ 878us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:06.928594 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:06.928625 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:06.930236 (+ 1611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:06.930240 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:06.931538 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:06.931550 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:06.932729 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:06.932734 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:06.932940 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:06.933672 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:06.933695 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:06.936207 (+ 2512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:06.939516 (+ 3309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:06.939526 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:06.939547 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:06.940211 (+ 664us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:06.940637 (+ 426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:06.940643 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:06.940647 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:06.940965 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:06.941610 (+ 645us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:06.941620 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:06.942001 (+ 381us) client_negotiation.cc:769] Sending connection context
0619 06:38:06.942284 (+ 283us) client_negotiation.cc:240] Negotiation successful
0619 06:38:06.942863 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":340,"threads_started":1}
I20260619 06:38:06.945791 11772 heartbeater.cc:347] Connected to a master server at 127.10.192.126:34329
I20260619 06:38:06.946164 11772 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:06.947101 11772 heartbeater.cc:511] Master 127.10.192.126:34329 requested a full tablet report, sending...
I20260619 06:38:06.949601 11583 ts_manager.cc:194] Registered new tserver with Master: 76943d46c7ef40eab95c667d75b4a60f (127.10.192.65:46803)
I20260619 06:38:06.951951 11583 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:58609
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
I20260619 06:38:06.967502 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:34329
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:33281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:07.295349 11778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:07.295717 11778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:07.295855 11778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:07.303490 11778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:07.303674 11778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:07.303934 11778 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:38:07.314164 11778 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:33281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:34329
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:07.315454 11778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:07.316797 11778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:07.330231 11786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:07.330299 11784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:07.330265 11783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:07.331003 11778 server_base.cc:1034] running on GCE node
I20260619 06:38:07.331673 11778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:07.332693 11778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:07.333966 11778 hybrid_clock.cc:648] HybridClock initialized: now 1781851087333864 us; error 53 us; skew 500 ppm
I20260619 06:38:07.334335 11778 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:07 dist-test-slave-7lz4 krb5kdc[11538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851087, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:07.337723 11778 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:38:07.339098 11778 webserver.cc:460] Webserver started at http://127.10.192.66:34199/ using document root <none> and password file <none>
I20260619 06:38:07.339807 11778 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:07.339908 11778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:07.340174 11778 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:07.342954 11778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "922d382de53b439ebd34a8ee4791fd7b"
format_stamp: "Formatted at 2026-06-19 06:38:07 on dist-test-slave-7lz4"
server_key: "49eb196be541b0e8357b0f0555faf357"
server_key_iv: "dfbdf6fa4d0aaf779eb7c997c18709cb"
server_key_version: "encryptionkey@0"
I20260619 06:38:07.343892 11778 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "922d382de53b439ebd34a8ee4791fd7b"
format_stamp: "Formatted at 2026-06-19 06:38:07 on dist-test-slave-7lz4"
server_key: "49eb196be541b0e8357b0f0555faf357"
server_key_iv: "dfbdf6fa4d0aaf779eb7c997c18709cb"
server_key_version: "encryptionkey@0"
I20260619 06:38:07.349037 11778 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260619 06:38:07.352733 11793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:07.354127 11778 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:38:07.354306 11778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "922d382de53b439ebd34a8ee4791fd7b"
format_stamp: "Formatted at 2026-06-19 06:38:07 on dist-test-slave-7lz4"
server_key: "49eb196be541b0e8357b0f0555faf357"
server_key_iv: "dfbdf6fa4d0aaf779eb7c997c18709cb"
server_key_version: "encryptionkey@0"
I20260619 06:38:07.354521 11778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:07.369764 11778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:07.374634 11778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:07.374876 11778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:07.375834 11778 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:07.377132 11778 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:07.377205 11778 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:07.377291 11778 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:07.377334 11778 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:07.408210 11778 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:36603
I20260619 06:38:07.408257 11905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:36603 every 8 connection(s)
I20260619 06:38:07.409425 11778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:38:07.415198 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 11778
I20260619 06:38:07.415405 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:38:07.415928 11009 external_mini_cluster.cc:1428] Setting key 63c13341cf6b9ac21f51252f7fd0d97d
Jun 19 06:38:07 dist-test-slave-7lz4 krb5kdc[11538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851087, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:07.430897 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:07.412054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:36269 (local address 127.10.192.126:34329)
0619 06:38:07.412272 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:07.412278 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:07.413496 (+ 1218us) server_negotiation.cc:407] Connection header received
0619 06:38:07.415284 (+ 1788us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:07.415291 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:07.415390 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:07.415521 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:07.417262 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:07.418150 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:07.419867 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:07.420682 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:07.420828 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:07.424819 (+ 3991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:07.424824 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:07.424827 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:07.424863 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:07.427705 (+ 2842us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:07.428534 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:07.428539 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:07.428545 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:07.428675 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:07.429135 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:07.429139 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:07.429141 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:07.429407 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:07.429565 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:07.430305 (+ 740us) server_negotiation.cc:299] Negotiation successful
0619 06:38:07.430531 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
WARNING: no policy specified for kudu/127.10.192.67@KRBTEST.COM; defaulting to no policy
I20260619 06:38:07.432132 11908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:07.412589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:34329 (local address 127.10.192.66:36269)
0619 06:38:07.413321 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:07.413363 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:07.414977 (+ 1614us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:07.415812 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:07.415821 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:07.416396 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:07.417079 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:07.417106 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:07.418320 (+ 1214us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:07.418324 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:07.419724 (+ 1400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:07.419736 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:07.420882 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:07.420888 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:07.421155 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:07.421877 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:07.421900 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:07.424557 (+ 2657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:07.427860 (+ 3303us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:07.427870 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:07.427890 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:07.428400 (+ 510us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:07.428789 (+ 389us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:07.428794 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:07.428798 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:07.429000 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:07.429539 (+ 539us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:07.429548 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:07.429935 (+ 387us) client_negotiation.cc:769] Sending connection context
0619 06:38:07.430208 (+ 273us) client_negotiation.cc:240] Negotiation successful
0619 06:38:07.430789 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":280,"threads_started":1}
I20260619 06:38:07.433683 11906 heartbeater.cc:347] Connected to a master server at 127.10.192.126:34329
I20260619 06:38:07.433971 11906 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:07.434765 11906 heartbeater.cc:511] Master 127.10.192.126:34329 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.67@KRBTEST.COM" created.
I20260619 06:38:07.436458 11583 ts_manager.cc:194] Registered new tserver with Master: 922d382de53b439ebd34a8ee4791fd7b (127.10.192.66:36603)
I20260619 06:38:07.437778 11583 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:36269
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
I20260619 06:38:07.458292 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:34329
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:33281
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:07.791328 11911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:07.791685 11911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:07.791817 11911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:07.799407 11911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:07.799566 11911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:07.799815 11911 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:38:07.810824 11911 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:33281
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:34329
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:07.812265 11911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:07.813587 11911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:07.827566 11919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:07.827523 11917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:07.827463 11916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:07.828501 11911 server_base.cc:1034] running on GCE node
I20260619 06:38:07.829217 11911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:07.830265 11911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:07.831506 11911 hybrid_clock.cc:648] HybridClock initialized: now 1781851087831461 us; error 47 us; skew 500 ppm
I20260619 06:38:07.831869 11911 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:07 dist-test-slave-7lz4 krb5kdc[11538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851087, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:07.835075 11911 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:38:07.836570 11911 webserver.cc:460] Webserver started at http://127.10.192.67:42157/ using document root <none> and password file <none>
I20260619 06:38:07.837327 11911 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:07.837426 11911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:07.837702 11911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:07.840806 11911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "98a24c56f6754dfabc4baab342242e09"
format_stamp: "Formatted at 2026-06-19 06:38:07 on dist-test-slave-7lz4"
server_key: "65dd7cf1894d6b9b6a0d6797ba54c927"
server_key_iv: "6e3c2888613076be514efd78db5ffd86"
server_key_version: "encryptionkey@0"
I20260619 06:38:07.841553 11911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "98a24c56f6754dfabc4baab342242e09"
format_stamp: "Formatted at 2026-06-19 06:38:07 on dist-test-slave-7lz4"
server_key: "65dd7cf1894d6b9b6a0d6797ba54c927"
server_key_iv: "6e3c2888613076be514efd78db5ffd86"
server_key_version: "encryptionkey@0"
I20260619 06:38:07.847012 11911 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 06:38:07.850745 11926 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:07.852445 11911 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260619 06:38:07.852645 11911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "98a24c56f6754dfabc4baab342242e09"
format_stamp: "Formatted at 2026-06-19 06:38:07 on dist-test-slave-7lz4"
server_key: "65dd7cf1894d6b9b6a0d6797ba54c927"
server_key_iv: "6e3c2888613076be514efd78db5ffd86"
server_key_version: "encryptionkey@0"
I20260619 06:38:07.852876 11911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:07.881446 11911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:07.885959 11911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:07.886278 11911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:07.887334 11911 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:07.888789 11911 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:07.888863 11911 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:07.889016 11911 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:07.889066 11911 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:07.923254 11911 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:41187
I20260619 06:38:07.923309 12038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:41187 every 8 connection(s)
I20260619 06:38:07.924603 11911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:38:07.925979 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 11911
I20260619 06:38:07.926172 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:38:07.926635 11009 external_mini_cluster.cc:1428] Setting key 4ff756dba36741b140274dbd907ee30d
Jun 19 06:38:07 dist-test-slave-7lz4 krb5kdc[11538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851087, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:07.944980 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:07.927649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:59143 (local address 127.10.192.126:34329)
0619 06:38:07.928037 (+ 388us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:07.928041 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:07.929298 (+ 1257us) server_negotiation.cc:407] Connection header received
0619 06:38:07.931216 (+ 1918us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:07.931220 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:07.931284 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:07.931365 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:07.932894 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:07.933783 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:07.935280 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:07.935767 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:07.935862 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:07.939443 (+ 3581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:07.939448 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:07.939451 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:07.939487 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:07.942193 (+ 2706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:07.942936 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:07.942940 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:07.942942 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:07.943069 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:07.943451 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:07.943454 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:07.943456 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:07.943778 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:07.943887 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:07.944561 (+ 674us) server_negotiation.cc:299] Negotiation successful
0619 06:38:07.944723 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":285}
I20260619 06:38:07.946050 12041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:07.928054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:34329 (local address 127.10.192.67:59143)
0619 06:38:07.929132 (+ 1078us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:07.929184 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:07.930976 (+ 1792us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:07.931583 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:07.931592 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:07.932168 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:07.932748 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:07.932765 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:07.933912 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:07.933915 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:07.935148 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:07.935163 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:07.935955 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:07.935960 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:07.936161 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:07.936921 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:07.936945 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:07.939225 (+ 2280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:07.942333 (+ 3108us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:07.942344 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:07.942364 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:07.942824 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:07.943162 (+ 338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:07.943166 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:07.943168 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:07.943352 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:07.943881 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:07.943887 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:07.944232 (+ 345us) client_negotiation.cc:769] Sending connection context
0619 06:38:07.944494 (+ 262us) client_negotiation.cc:240] Negotiation successful
0619 06:38:07.944907 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":798,"thread_start_us":374,"threads_started":1}
I20260619 06:38:07.947523 12039 heartbeater.cc:347] Connected to a master server at 127.10.192.126:34329
I20260619 06:38:07.947898 12039 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:07.948654 12039 heartbeater.cc:511] Master 127.10.192.126:34329 requested a full tablet report, sending...
I20260619 06:38:07.950189 11583 ts_manager.cc:194] Registered new tserver with Master: 98a24c56f6754dfabc4baab342242e09 (127.10.192.67:41187)
I20260619 06:38:07.951013 11583 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:59143
I20260619 06:38:07.954607 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 06:38:07.956158 11772 heartbeater.cc:503] Master 127.10.192.126:34329 was elected leader, sending a full tablet report...
I20260619 06:38:07.973512 11774 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:07.961401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51906 (local address 127.10.192.126:34329)
0619 06:38:07.961578 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:07.961582 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:07.962063 (+ 481us) server_negotiation.cc:407] Connection header received
0619 06:38:07.962202 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:07.962206 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:07.962265 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:07.962348 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:07.963916 (+ 1568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:07.964649 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:07.965870 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:07.966263 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:07.966351 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:07.968722 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:07.968726 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:07.968729 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:07.968758 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:07.971199 (+ 2441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:07.971908 (+ 709us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:07.971912 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:07.971914 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:07.972049 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:07.972365 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:07.972368 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:07.972370 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:07.972657 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:07.972843 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:07.973119 (+ 276us) server_negotiation.cc:299] Negotiation successful
0619 06:38:07.973275 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260619 06:38:07.979972 11583 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51906:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:38:07.986716 11583 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:38:08.022727 12052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:07.999966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56106 (local address 127.10.192.66:36603)
0619 06:38:08.012663 (+ 12697us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:08.012673 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:08.012706 (+ 33us) server_negotiation.cc:407] Connection header received
0619 06:38:08.012808 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:08.012818 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:08.013132 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:08.013348 (+ 216us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:08.014164 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.015288 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.019406 (+ 4118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.021032 (+ 1626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.021179 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:08.021371 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:08.022214 (+ 843us) server_negotiation.cc:299] Negotiation successful
0619 06:38:08.022415 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12512,"thread_start_us":13565,"threads_started":1}
I20260619 06:38:08.022769 12051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:08.000714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:41187 (local address 127.0.0.1:33152)
0619 06:38:08.014108 (+ 13394us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:08.014130 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:08.014252 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:08.015949 (+ 1697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:08.015953 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:08.015976 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:08.016399 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:08.016411 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.017981 (+ 1570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.017989 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:08.019865 (+ 1876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:08.019884 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.021895 (+ 2011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.021901 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:08.022071 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:08.022106 (+ 35us) client_negotiation.cc:769] Sending connection context
0619 06:38:08.022196 (+ 90us) client_negotiation.cc:240] Negotiation successful
0619 06:38:08.022332 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13240,"mutex_wait_us":3,"thread_start_us":8257,"threads_started":1}
I20260619 06:38:08.023412 12054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:07.999731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:36603 (local address 127.0.0.1:56106)
0619 06:38:08.009437 (+ 9706us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:08.010582 (+ 1145us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:08.010871 (+ 289us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:08.013389 (+ 2518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:08.013401 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:08.013443 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:08.013939 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:08.013962 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.015450 (+ 1488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.015458 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:08.018867 (+ 3409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:08.018881 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.021494 (+ 2613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.021500 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:08.021702 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:08.021763 (+ 61us) client_negotiation.cc:769] Sending connection context
0619 06:38:08.021927 (+ 164us) client_negotiation.cc:240] Negotiation successful
0619 06:38:08.022147 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9412,"thread_start_us":14378,"threads_started":1}
I20260619 06:38:08.023504 12056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:08.002029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33152 (local address 127.10.192.67:41187)
0619 06:38:08.014981 (+ 12952us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:08.014993 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:08.015039 (+ 46us) server_negotiation.cc:407] Connection header received
0619 06:38:08.015158 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:08.015169 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:08.015510 (+ 341us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:08.015756 (+ 246us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:08.016648 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.017834 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.020063 (+ 2229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.021697 (+ 1634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.021826 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:08.022055 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:08.022455 (+ 400us) server_negotiation.cc:299] Negotiation successful
0619 06:38:08.022618 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12745,"thread_start_us":12599,"threads_started":1}
I20260619 06:38:08.023936 12053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:08.000138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:46803 (local address 127.0.0.1:60260)
0619 06:38:08.012077 (+ 11939us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:08.012107 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:08.012280 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:08.016612 (+ 4332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:08.016617 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:08.016642 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:08.017090 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:08.017106 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.019177 (+ 2071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.019184 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:08.021234 (+ 2050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:08.021248 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.023110 (+ 1862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.023117 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:08.023282 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:08.023321 (+ 39us) client_negotiation.cc:769] Sending connection context
0619 06:38:08.023420 (+ 99us) client_negotiation.cc:240] Negotiation successful
0619 06:38:08.023543 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11741,"mutex_wait_us":3,"thread_start_us":12251,"threads_started":1}
I20260619 06:38:08.023996 12055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:08.001579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60260 (local address 127.10.192.65:46803)
0619 06:38:08.015972 (+ 14393us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:08.015981 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:08.016011 (+ 30us) server_negotiation.cc:407] Connection header received
0619 06:38:08.016109 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:08.016118 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:08.016388 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:08.017286 (+ 898us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:08.017495 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.019036 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.021416 (+ 2380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.022893 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.023061 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:08.023288 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:08.023495 (+ 207us) server_negotiation.cc:299] Negotiation successful
0619 06:38:08.023684 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14200,"thread_start_us":14054,"threads_started":1}
I20260619 06:38:08.027462 11841 tablet_service.cc:1467] Processing CreateTablet for tablet 6810f9c65ed542bf8b832f5be59a9f74 (DEFAULT_TABLE table=test-table [id=fe1c833f15af432b9b952952455a1b91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:08.027482 11707 tablet_service.cc:1467] Processing CreateTablet for tablet 6810f9c65ed542bf8b832f5be59a9f74 (DEFAULT_TABLE table=test-table [id=fe1c833f15af432b9b952952455a1b91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:08.027472 11974 tablet_service.cc:1467] Processing CreateTablet for tablet 6810f9c65ed542bf8b832f5be59a9f74 (DEFAULT_TABLE table=test-table [id=fe1c833f15af432b9b952952455a1b91]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:08.028779 11841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6810f9c65ed542bf8b832f5be59a9f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:08.028879 11707 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6810f9c65ed542bf8b832f5be59a9f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:08.028879 11974 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6810f9c65ed542bf8b832f5be59a9f74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:08.040603 12057 tablet_bootstrap.cc:492] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b: Bootstrap starting.
I20260619 06:38:08.043929 12057 tablet_bootstrap.cc:654] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:08.045413 12057 log.cc:824] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:08.045568 12058 tablet_bootstrap.cc:492] T 6810f9c65ed542bf8b832f5be59a9f74 P 76943d46c7ef40eab95c667d75b4a60f: Bootstrap starting.
I20260619 06:38:08.047801 12059 tablet_bootstrap.cc:492] T 6810f9c65ed542bf8b832f5be59a9f74 P 98a24c56f6754dfabc4baab342242e09: Bootstrap starting.
I20260619 06:38:08.049423 12057 tablet_bootstrap.cc:492] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b: No bootstrap required, opened a new log
I20260619 06:38:08.049595 12058 tablet_bootstrap.cc:654] T 6810f9c65ed542bf8b832f5be59a9f74 P 76943d46c7ef40eab95c667d75b4a60f: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:08.049775 12057 ts_tablet_manager.cc:1397] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260619 06:38:08.050915 12058 log.cc:824] T 6810f9c65ed542bf8b832f5be59a9f74 P 76943d46c7ef40eab95c667d75b4a60f: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:08.051416 12059 tablet_bootstrap.cc:654] T 6810f9c65ed542bf8b832f5be59a9f74 P 98a24c56f6754dfabc4baab342242e09: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:08.052625 12059 log.cc:824] T 6810f9c65ed542bf8b832f5be59a9f74 P 98a24c56f6754dfabc4baab342242e09: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:08.054991 12058 tablet_bootstrap.cc:492] T 6810f9c65ed542bf8b832f5be59a9f74 P 76943d46c7ef40eab95c667d75b4a60f: No bootstrap required, opened a new log
I20260619 06:38:08.055333 12058 ts_tablet_manager.cc:1397] T 6810f9c65ed542bf8b832f5be59a9f74 P 76943d46c7ef40eab95c667d75b4a60f: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260619 06:38:08.058631 12059 tablet_bootstrap.cc:492] T 6810f9c65ed542bf8b832f5be59a9f74 P 98a24c56f6754dfabc4baab342242e09: No bootstrap required, opened a new log
I20260619 06:38:08.058897 12059 ts_tablet_manager.cc:1397] T 6810f9c65ed542bf8b832f5be59a9f74 P 98a24c56f6754dfabc4baab342242e09: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20260619 06:38:08.058908 12057 raft_consensus.cc:348] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "922d382de53b439ebd34a8ee4791fd7b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36603 } } peers { permanent_uuid: "76943d46c7ef40eab95c667d75b4a60f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46803 } } peers { permanent_uuid: "98a24c56f6754dfabc4baab342242e09" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41187 } }
I20260619 06:38:08.059343 12057 raft_consensus.cc:374] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:08.059456 12057 raft_consensus.cc:729] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 922d382de53b439ebd34a8ee4791fd7b, State: Initialized, Role: FOLLOWER
I20260619 06:38:08.060132 12057 consensus_queue.cc:260] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "922d382de53b439ebd34a8ee4791fd7b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36603 } } peers { permanent_uuid: "76943d46c7ef40eab95c667d75b4a60f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46803 } } peers { permanent_uuid: "98a24c56f6754dfabc4baab342242e09" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41187 } }
I20260619 06:38:08.061249 11906 heartbeater.cc:503] Master 127.10.192.126:34329 was elected leader, sending a full tablet report...
I20260619 06:38:08.063099 12057 ts_tablet_manager.cc:1428] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260619 06:38:08.066242 12058 raft_consensus.cc:348] T 6810f9c65ed542bf8b832f5be59a9f74 P 76943d46c7ef40eab95c667d75b4a60f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "922d382de53b439ebd34a8ee4791fd7b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36603 } } peers { permanent_uuid: "76943d46c7ef40eab95c667d75b4a60f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46803 } } peers { permanent_uuid: "98a24c56f6754dfabc4baab342242e09" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41187 } }
I20260619 06:38:08.066697 12058 raft_consensus.cc:374] T 6810f9c65ed542bf8b832f5be59a9f74 P 76943d46c7ef40eab95c667d75b4a60f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:08.066799 12058 raft_consensus.cc:729] T 6810f9c65ed542bf8b832f5be59a9f74 P 76943d46c7ef40eab95c667d75b4a60f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76943d46c7ef40eab95c667d75b4a60f, State: Initialized, Role: FOLLOWER
I20260619 06:38:08.067517 12058 consensus_queue.cc:260] T 6810f9c65ed542bf8b832f5be59a9f74 P 76943d46c7ef40eab95c667d75b4a60f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "922d382de53b439ebd34a8ee4791fd7b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36603 } } peers { permanent_uuid: "76943d46c7ef40eab95c667d75b4a60f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46803 } } peers { permanent_uuid: "98a24c56f6754dfabc4baab342242e09" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41187 } }
I20260619 06:38:08.069329 12058 ts_tablet_manager.cc:1428] T 6810f9c65ed542bf8b832f5be59a9f74 P 76943d46c7ef40eab95c667d75b4a60f: Time spent starting tablet: real 0.014s user 0.007s sys 0.008s
I20260619 06:38:08.069834 12059 raft_consensus.cc:348] T 6810f9c65ed542bf8b832f5be59a9f74 P 98a24c56f6754dfabc4baab342242e09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "922d382de53b439ebd34a8ee4791fd7b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36603 } } peers { permanent_uuid: "76943d46c7ef40eab95c667d75b4a60f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46803 } } peers { permanent_uuid: "98a24c56f6754dfabc4baab342242e09" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41187 } }
I20260619 06:38:08.070195 12059 raft_consensus.cc:374] T 6810f9c65ed542bf8b832f5be59a9f74 P 98a24c56f6754dfabc4baab342242e09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:08.070294 12059 raft_consensus.cc:729] T 6810f9c65ed542bf8b832f5be59a9f74 P 98a24c56f6754dfabc4baab342242e09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98a24c56f6754dfabc4baab342242e09, State: Initialized, Role: FOLLOWER
I20260619 06:38:08.070919 12059 consensus_queue.cc:260] T 6810f9c65ed542bf8b832f5be59a9f74 P 98a24c56f6754dfabc4baab342242e09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "922d382de53b439ebd34a8ee4791fd7b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36603 } } peers { permanent_uuid: "76943d46c7ef40eab95c667d75b4a60f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46803 } } peers { permanent_uuid: "98a24c56f6754dfabc4baab342242e09" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41187 } }
I20260619 06:38:08.072023 12039 heartbeater.cc:503] Master 127.10.192.126:34329 was elected leader, sending a full tablet report...
I20260619 06:38:08.072526 12059 ts_tablet_manager.cc:1428] T 6810f9c65ed542bf8b832f5be59a9f74 P 98a24c56f6754dfabc4baab342242e09: Time spent starting tablet: real 0.014s user 0.013s sys 0.001s
I20260619 06:38:08.085362 12063 raft_consensus.cc:482] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:38:08.085678 12063 raft_consensus.cc:504] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "922d382de53b439ebd34a8ee4791fd7b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36603 } } peers { permanent_uuid: "76943d46c7ef40eab95c667d75b4a60f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46803 } } peers { permanent_uuid: "98a24c56f6754dfabc4baab342242e09" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41187 } }
I20260619 06:38:08.087414 12063 leader_election.cc:288] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76943d46c7ef40eab95c667d75b4a60f (127.10.192.65:46803), 98a24c56f6754dfabc4baab342242e09 (127.10.192.67:41187)
I20260619 06:38:08.094687 12056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:08.087982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:47625 (local address 127.10.192.67:41187)
0619 06:38:08.088223 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:08.088233 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:08.088947 (+ 714us) server_negotiation.cc:407] Connection header received
0619 06:38:08.089145 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:08.089150 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:08.089214 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:08.089308 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:08.089915 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.090622 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.092450 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.093523 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.093694 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:08.093778 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:08.094260 (+ 482us) server_negotiation.cc:299] Negotiation successful
0619 06:38:08.094408 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 06:38:08.094691 12055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:08.087880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:36359 (local address 127.10.192.65:46803)
0619 06:38:08.088129 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:08.088135 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:08.088834 (+ 699us) server_negotiation.cc:407] Connection header received
0619 06:38:08.089054 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:08.089059 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:08.089125 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:08.089225 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:08.089749 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.090478 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.092498 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.093528 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.093686 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:08.093769 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:08.094260 (+ 491us) server_negotiation.cc:299] Negotiation successful
0619 06:38:08.094408 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260619 06:38:08.094867 12066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:08.087853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:46803 (local address 127.10.192.66:36359)
0619 06:38:08.088703 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:08.088727 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:08.088913 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:08.089239 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:08.089243 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:08.089265 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:08.089608 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:08.089619 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.090606 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.090613 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:08.092320 (+ 1707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:08.092335 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.093915 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.093921 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:08.094054 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:08.094124 (+ 70us) client_negotiation.cc:769] Sending connection context
0619 06:38:08.094236 (+ 112us) client_negotiation.cc:240] Negotiation successful
0619 06:38:08.094417 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":670,"mutex_wait_us":121,"thread_start_us":423,"threads_started":1}
I20260619 06:38:08.094982 12067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:08.088227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:41187 (local address 127.10.192.66:47625)
0619 06:38:08.088824 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:08.088837 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:08.089011 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:08.089325 (+ 314us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:08.089329 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:08.089367 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:08.089774 (+ 407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:08.089782 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.090766 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.090772 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:08.092289 (+ 1517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:08.092305 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.093951 (+ 1646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.093956 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:08.094105 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:08.094128 (+ 23us) client_negotiation.cc:769] Sending connection context
0619 06:38:08.094236 (+ 108us) client_negotiation.cc:240] Negotiation successful
0619 06:38:08.094412 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"mutex_wait_us":28,"thread_start_us":319,"threads_started":1}
I20260619 06:38:08.096009 11994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6810f9c65ed542bf8b832f5be59a9f74" candidate_uuid: "922d382de53b439ebd34a8ee4791fd7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98a24c56f6754dfabc4baab342242e09" is_pre_election: true
I20260619 06:38:08.096010 11727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6810f9c65ed542bf8b832f5be59a9f74" candidate_uuid: "922d382de53b439ebd34a8ee4791fd7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76943d46c7ef40eab95c667d75b4a60f" is_pre_election: true
I20260619 06:38:08.096458 11994 raft_consensus.cc:2454] T 6810f9c65ed542bf8b832f5be59a9f74 P 98a24c56f6754dfabc4baab342242e09 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922d382de53b439ebd34a8ee4791fd7b in term 0.
I20260619 06:38:08.096521 11727 raft_consensus.cc:2454] T 6810f9c65ed542bf8b832f5be59a9f74 P 76943d46c7ef40eab95c667d75b4a60f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 922d382de53b439ebd34a8ee4791fd7b in term 0.
I20260619 06:38:08.097154 11797 leader_election.cc:302] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 922d382de53b439ebd34a8ee4791fd7b, 98a24c56f6754dfabc4baab342242e09; no voters:
I20260619 06:38:08.097630 12063 raft_consensus.cc:2781] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:38:08.097776 12063 raft_consensus.cc:482] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:38:08.097899 12063 raft_consensus.cc:3037] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:08.100160 12063 raft_consensus.cc:504] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "922d382de53b439ebd34a8ee4791fd7b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36603 } } peers { permanent_uuid: "76943d46c7ef40eab95c667d75b4a60f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46803 } } peers { permanent_uuid: "98a24c56f6754dfabc4baab342242e09" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41187 } }
I20260619 06:38:08.100867 12063 leader_election.cc:288] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b [CANDIDATE]: Term 1 election: Requested vote from peers 76943d46c7ef40eab95c667d75b4a60f (127.10.192.65:46803), 98a24c56f6754dfabc4baab342242e09 (127.10.192.67:41187)
I20260619 06:38:08.101327 11727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6810f9c65ed542bf8b832f5be59a9f74" candidate_uuid: "922d382de53b439ebd34a8ee4791fd7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76943d46c7ef40eab95c667d75b4a60f"
I20260619 06:38:08.101459 11994 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6810f9c65ed542bf8b832f5be59a9f74" candidate_uuid: "922d382de53b439ebd34a8ee4791fd7b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98a24c56f6754dfabc4baab342242e09"
I20260619 06:38:08.101567 11727 raft_consensus.cc:3037] T 6810f9c65ed542bf8b832f5be59a9f74 P 76943d46c7ef40eab95c667d75b4a60f [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:08.101665 11994 raft_consensus.cc:3037] T 6810f9c65ed542bf8b832f5be59a9f74 P 98a24c56f6754dfabc4baab342242e09 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:08.104933 11994 raft_consensus.cc:2454] T 6810f9c65ed542bf8b832f5be59a9f74 P 98a24c56f6754dfabc4baab342242e09 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922d382de53b439ebd34a8ee4791fd7b in term 1.
I20260619 06:38:08.104933 11727 raft_consensus.cc:2454] T 6810f9c65ed542bf8b832f5be59a9f74 P 76943d46c7ef40eab95c667d75b4a60f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 922d382de53b439ebd34a8ee4791fd7b in term 1.
I20260619 06:38:08.105437 11797 leader_election.cc:302] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 922d382de53b439ebd34a8ee4791fd7b, 98a24c56f6754dfabc4baab342242e09; no voters:
I20260619 06:38:08.105813 12063 raft_consensus.cc:2781] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:08.106249 12063 raft_consensus.cc:686] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b [term 1 LEADER]: Becoming Leader. State: Replica: 922d382de53b439ebd34a8ee4791fd7b, State: Running, Role: LEADER
I20260619 06:38:08.106830 12063 consensus_queue.cc:237] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "922d382de53b439ebd34a8ee4791fd7b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36603 } } peers { permanent_uuid: "76943d46c7ef40eab95c667d75b4a60f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46803 } } peers { permanent_uuid: "98a24c56f6754dfabc4baab342242e09" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41187 } }
I20260619 06:38:08.111544 11583 catalog_manager.cc:5495] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b reported cstate change: term changed from 0 to 1, leader changed from <none> to 922d382de53b439ebd34a8ee4791fd7b (127.10.192.66). New cstate: current_term: 1 leader_uuid: "922d382de53b439ebd34a8ee4791fd7b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "922d382de53b439ebd34a8ee4791fd7b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36603 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "76943d46c7ef40eab95c667d75b4a60f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "98a24c56f6754dfabc4baab342242e09" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41187 } health_report { overall_health: UNKNOWN } } }
Jun 19 06:38:08 dist-test-slave-7lz4 krb5kdc[11538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:38:08.154842 12055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:08.140014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60276 (local address 127.10.192.65:46803)
0619 06:38:08.140185 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:08.140190 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:08.140714 (+ 524us) server_negotiation.cc:407] Connection header received
0619 06:38:08.140938 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:08.140948 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:08.141011 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:08.141119 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:08.142571 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.143333 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.144621 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.145037 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.145168 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:08.149146 (+ 3978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:08.149163 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:08.149183 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:08.149222 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:08.151966 (+ 2744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:08.152748 (+ 782us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:08.152755 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:08.152757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:08.152888 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:08.153247 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:08.153254 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:08.153257 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:08.153665 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:08.153963 (+ 298us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:08.154263 (+ 300us) server_negotiation.cc:299] Negotiation successful
0619 06:38:08.154490 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260619 06:38:08.161369 11907 tablet.cc:2369] T 6810f9c65ed542bf8b832f5be59a9f74 P 922d382de53b439ebd34a8ee4791fd7b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 06:38:08.171028 11773 tablet.cc:2369] T 6810f9c65ed542bf8b832f5be59a9f74 P 76943d46c7ef40eab95c667d75b4a60f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 06:38:08.176221 12040 tablet.cc:2369] T 6810f9c65ed542bf8b832f5be59a9f74 P 98a24c56f6754dfabc4baab342242e09: Can't schedule compaction. Clean time has not been advanced past its initial value.
Jun 19 06:38:08 dist-test-slave-7lz4 krb5kdc[11538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851088, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 19 06:38:08 dist-test-slave-7lz4 krb5kdc[11538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851088, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:38:08.200410 12055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:08.186871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60292 (local address 127.10.192.65:46803)
0619 06:38:08.187056 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:08.187061 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:08.187469 (+ 408us) server_negotiation.cc:407] Connection header received
0619 06:38:08.187605 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:08.187608 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:08.187729 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:08.187825 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:08.189153 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.189891 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.191113 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.191517 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.191609 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:08.195404 (+ 3795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:08.195409 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:08.195412 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:08.195462 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:08.198215 (+ 2753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:08.198783 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:08.198787 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:08.198789 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:08.198910 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:08.199257 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:08.199260 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:08.199262 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:08.199523 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:08.199770 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:08.200000 (+ 230us) server_negotiation.cc:299] Negotiation successful
0619 06:38:08.200171 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
Jun 19 06:38:08 dist-test-slave-7lz4 krb5kdc[11538](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 19 06:38:08 dist-test-slave-7lz4 krb5kdc[11538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:38:08.244086 12055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:08.230721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60300 (local address 127.10.192.65:46803)
0619 06:38:08.230989 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:08.230995 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:08.231198 (+ 203us) server_negotiation.cc:407] Connection header received
0619 06:38:08.231343 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:08.231347 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:08.231445 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:08.231533 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:08.232897 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.233600 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.234743 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.235161 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.235256 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:08.239161 (+ 3905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:08.239166 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:08.239170 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:08.239208 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:08.241749 (+ 2541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:08.242351 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:08.242354 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:08.242357 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:08.242493 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:08.242786 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:08.242788 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:08.242790 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:08.243062 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:08.243244 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:08.243482 (+ 238us) server_negotiation.cc:299] Negotiation successful
0619 06:38:08.243719 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
W20260619 06:38:08.245877 11687 tablet_service.cc:2908] Rejecting scan request for tablet 6810f9c65ed542bf8b832f5be59a9f74: Uninitialized: clean time has not yet been initialized
I20260619 06:38:08.248736 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 11644
I20260619 06:38:08.261654 12055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:08.249788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60314 (local address 127.10.192.65:46803)
0619 06:38:08.249948 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:08.249952 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:08.250335 (+ 383us) server_negotiation.cc:407] Connection header received
0619 06:38:08.250470 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:08.250473 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:08.250537 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:08.250618 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:08.251786 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.252457 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.253715 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.254093 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.254198 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:08.256430 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:08.256436 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:08.256439 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:08.256471 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:08.259270 (+ 2799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:08.260050 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:08.260054 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:08.260056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:08.260168 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:08.260489 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:08.260492 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:08.260494 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:08.260762 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:08.260975 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:08.261248 (+ 273us) server_negotiation.cc:299] Negotiation successful
0619 06:38:08.261413 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260619 06:38:08.262379 11767 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:08.352413 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 11644
I20260619 06:38:08.369314 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 11778
Jun 19 06:38:08 dist-test-slave-7lz4 krb5kdc[11538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.66@KRBTEST.COM
I20260619 06:38:08.384686 12052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:08.370128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56114 (local address 127.10.192.66:36603)
0619 06:38:08.370337 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:08.370345 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:08.370367 (+ 22us) server_negotiation.cc:407] Connection header received
0619 06:38:08.370606 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:08.370616 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:08.370678 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:08.370782 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:08.371989 (+ 1207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.372723 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.373954 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.374354 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.374495 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:08.378702 (+ 4207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:08.378719 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:08.378736 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:08.378772 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:08.381646 (+ 2874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:08.382407 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:08.382415 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:08.382417 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:08.382554 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:08.382922 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:08.382925 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:08.382927 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:08.383269 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:08.383503 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:08.384227 (+ 724us) server_negotiation.cc:299] Negotiation successful
0619 06:38:08.384445 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 06:38:08.385469 11901 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:08.474750 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 11778
I20260619 06:38:08.492338 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 11911
Jun 19 06:38:08 dist-test-slave-7lz4 krb5kdc[11538](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851088, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.67@KRBTEST.COM
I20260619 06:38:08.507776 12056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:08.493178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33154 (local address 127.10.192.67:41187)
0619 06:38:08.493364 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:08.493368 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:08.493427 (+ 59us) server_negotiation.cc:407] Connection header received
0619 06:38:08.493604 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:08.493608 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:08.493678 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:08.493762 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:08.494906 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.495620 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.496897 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:08.497287 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:08.497382 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:08.501905 (+ 4523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:08.501918 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:08.501934 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:08.501981 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:08.504905 (+ 2924us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:08.505659 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:08.505667 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:08.505669 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:08.505793 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:08.506184 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:08.506191 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:08.506194 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:08.506549 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:08.506834 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:08.507161 (+ 327us) server_negotiation.cc:299] Negotiation successful
0619 06:38:08.507391 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260619 06:38:08.508423 12034 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:08.597764 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 11911
I20260619 06:38:08.613909 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 11551
I20260619 06:38:08.615298 11613 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:08.730542 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 11551
2026-06-19T06:38:08Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (4153 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:38:08 dist-test-slave-7lz4 krb5kdc[12087](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:38:08 dist-test-slave-7lz4 krb5kdc[12087](info): set up 2 sockets
Jun 19 06:38:08 dist-test-slave-7lz4 krb5kdc[12087](info): commencing operation
krb5kdc: starting...
W20260619 06:38:09.815977 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.000s sys 0.016s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:38:09 dist-test-slave-7lz4 krb5kdc[12087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851089, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:38:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:38:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:38:09.999320 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:40657
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:35607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:40657
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:10.321741 12100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:10.322105 12100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:10.322275 12100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:10.329730 12100 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:38:10.329900 12100 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260619 06:38:10.329999 12100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:10.330127 12100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:10.330214 12100 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:38:10.330302 12100 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:38:10.340548 12100 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:35607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:40657
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:40657
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:10.341921 12100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:10.343286 12100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:10.355959 12105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:10.356041 12106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:10.355988 12108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:10.356871 12100 server_base.cc:1034] running on GCE node
I20260619 06:38:10.357741 12100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:10.360391 12100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:10.361630 12100 hybrid_clock.cc:648] HybridClock initialized: now 1781851090361565 us; error 55 us; skew 500 ppm
I20260619 06:38:10.361995 12100 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:10 dist-test-slave-7lz4 krb5kdc[12087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851090, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:10.365324 12100 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:38:10.366997 12100 webserver.cc:460] Webserver started at http://127.10.192.126:38395/ using document root <none> and password file <none>
I20260619 06:38:10.367821 12100 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:10.367939 12100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:10.368275 12100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:10.371269 12100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "cdc7a374db824e8b99e4965a4a57cb24"
format_stamp: "Formatted at 2026-06-19 06:38:10 on dist-test-slave-7lz4"
server_key: "2754feee163afbf4c62a2b140dc9b99f"
server_key_iv: "d16fb2cf73c33f5c98d34fd2bc26bf2b"
server_key_version: "encryptionkey@0"
I20260619 06:38:10.372131 12100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "cdc7a374db824e8b99e4965a4a57cb24"
format_stamp: "Formatted at 2026-06-19 06:38:10 on dist-test-slave-7lz4"
server_key: "2754feee163afbf4c62a2b140dc9b99f"
server_key_iv: "d16fb2cf73c33f5c98d34fd2bc26bf2b"
server_key_version: "encryptionkey@0"
I20260619 06:38:10.377656 12100 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 06:38:10.381338 12115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:10.382761 12100 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 06:38:10.382959 12100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "cdc7a374db824e8b99e4965a4a57cb24"
format_stamp: "Formatted at 2026-06-19 06:38:10 on dist-test-slave-7lz4"
server_key: "2754feee163afbf4c62a2b140dc9b99f"
server_key_iv: "d16fb2cf73c33f5c98d34fd2bc26bf2b"
server_key_version: "encryptionkey@0"
I20260619 06:38:10.383188 12100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:10.399066 12100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:10.403437 12100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:10.403759 12100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:10.425709 12100 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:40657
I20260619 06:38:10.425714 12176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:40657 every 8 connection(s)
I20260619 06:38:10.427220 12100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:38:10.430987 12177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:10.437354 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 12100
I20260619 06:38:10.437614 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:38:10.438279 11009 external_mini_cluster.cc:1428] Setting key 0d7ed4c43c10d1deec00013e27e393b5
I20260619 06:38:10.441979 12177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24: Bootstrap starting.
I20260619 06:38:10.446013 12177 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:10.447357 12177 log.cc:824] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:10.451133 12177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24: No bootstrap required, opened a new log
Jun 19 06:38:10 dist-test-slave-7lz4 krb5kdc[12087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851089, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:10.461278 12177 raft_consensus.cc:348] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdc7a374db824e8b99e4965a4a57cb24" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40657 } }
I20260619 06:38:10.461766 12177 raft_consensus.cc:374] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:10.461890 12177 raft_consensus.cc:729] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdc7a374db824e8b99e4965a4a57cb24, State: Initialized, Role: FOLLOWER
I20260619 06:38:10.462587 12177 consensus_queue.cc:260] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdc7a374db824e8b99e4965a4a57cb24" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40657 } }
I20260619 06:38:10.462857 12177 raft_consensus.cc:388] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:38:10.463045 12177 raft_consensus.cc:482] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:38:10.463225 12177 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:10.464370 12180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:10.440392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39040 (local address 127.10.192.126:40657)
0619 06:38:10.441236 (+ 844us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:10.441252 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:10.441313 (+ 61us) server_negotiation.cc:407] Connection header received
0619 06:38:10.443778 (+ 2465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:10.443814 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:10.444491 (+ 677us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:10.444930 (+ 439us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:10.446256 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:10.448446 (+ 2190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:10.449957 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:10.450979 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:10.451170 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:10.455380 (+ 4210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:10.455390 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:10.455413 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:10.455474 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:10.459722 (+ 4248us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:10.460451 (+ 729us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:10.460459 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:10.460469 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:10.460681 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:10.461027 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:10.461035 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:10.461039 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:10.461794 (+ 755us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:10.462097 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:10.462562 (+ 465us) server_negotiation.cc:299] Negotiation successful
0619 06:38:10.463068 (+ 506us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":371,"threads_started":1}
I20260619 06:38:10.465808 12177 raft_consensus.cc:504] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdc7a374db824e8b99e4965a4a57cb24" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40657 } }
I20260619 06:38:10.466334 12177 leader_election.cc:302] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cdc7a374db824e8b99e4965a4a57cb24; no voters:
I20260619 06:38:10.466964 12177 leader_election.cc:288] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:38:10.467098 12182 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:10.467883 12182 raft_consensus.cc:686] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24 [term 1 LEADER]: Becoming Leader. State: Replica: cdc7a374db824e8b99e4965a4a57cb24, State: Running, Role: LEADER
I20260619 06:38:10.468470 12182 consensus_queue.cc:237] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdc7a374db824e8b99e4965a4a57cb24" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40657 } }
I20260619 06:38:10.469331 12177 sys_catalog.cc:564] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:38:10.471259 12183 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cdc7a374db824e8b99e4965a4a57cb24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdc7a374db824e8b99e4965a4a57cb24" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40657 } } }
I20260619 06:38:10.471756 12183 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:10.471727 12184 sys_catalog.cc:455] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cdc7a374db824e8b99e4965a4a57cb24. Latest consensus state: current_term: 1 leader_uuid: "cdc7a374db824e8b99e4965a4a57cb24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cdc7a374db824e8b99e4965a4a57cb24" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40657 } } }
I20260619 06:38:10.472337 12184 sys_catalog.cc:458] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:10.474831 12189 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:38:10.479557 12189 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:38:10.488844 12189 catalog_manager.cc:1347] Generated new cluster ID: 7dfd5ad02ff240478b5f9351b37b067b
I20260619 06:38:10.488969 12189 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:38:10.505908 12189 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:38:10.507256 12189 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:38:10.516494 12189 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24: Generated new TSK 0
I20260619 06:38:10.517658 12189 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
I20260619 06:38:10.569427 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:40657
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:35607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:10.911818 12203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:10.912134 12203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:10.912303 12203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:10.919896 12203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:10.920042 12203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:10.920181 12203 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 06:38:10.920307 12203 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:38:10.930709 12203 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:35607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.192.126:40657
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:10.932121 12203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:10.933561 12203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:10.947728 12208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:10.947651 12209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:10.947690 12211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:10.948555 12203 server_base.cc:1034] running on GCE node
I20260619 06:38:10.949267 12203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:10.950322 12203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:10.951594 12203 hybrid_clock.cc:648] HybridClock initialized: now 1781851090951537 us; error 39 us; skew 500 ppm
I20260619 06:38:10.951990 12203 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:10 dist-test-slave-7lz4 krb5kdc[12087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851090, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:10.955300 12203 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:38:10.957098 12203 webserver.cc:460] Webserver started at http://127.10.192.65:42185/ using document root <none> and password file <none>
I20260619 06:38:10.957863 12203 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:10.958021 12203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:10.958353 12203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:10.961771 12203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "778825b73dcb4c8abfa702b9de030d62"
format_stamp: "Formatted at 2026-06-19 06:38:10 on dist-test-slave-7lz4"
server_key: "aea832df3c0015e89265dc37dda797ab"
server_key_iv: "224294d680db124ae1cbc8c21a31ba6a"
server_key_version: "encryptionkey@0"
I20260619 06:38:10.962664 12203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "778825b73dcb4c8abfa702b9de030d62"
format_stamp: "Formatted at 2026-06-19 06:38:10 on dist-test-slave-7lz4"
server_key: "aea832df3c0015e89265dc37dda797ab"
server_key_iv: "224294d680db124ae1cbc8c21a31ba6a"
server_key_version: "encryptionkey@0"
I20260619 06:38:10.968652 12203 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260619 06:38:10.972522 12218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:10.974264 12203 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:38:10.974463 12203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "778825b73dcb4c8abfa702b9de030d62"
format_stamp: "Formatted at 2026-06-19 06:38:10 on dist-test-slave-7lz4"
server_key: "aea832df3c0015e89265dc37dda797ab"
server_key_iv: "224294d680db124ae1cbc8c21a31ba6a"
server_key_version: "encryptionkey@0"
I20260619 06:38:10.974727 12203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:10.990181 12203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:10.994738 12203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:10.995030 12203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:10.997902 12203 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:10.998029 12203 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:10.998186 12203 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:10.998270 12203 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 06:38:11 dist-test-slave-7lz4 krb5kdc[12087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851090, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:11.024726 12227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:10.999017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:58239 (local address 127.10.192.126:40657)
0619 06:38:10.999523 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:10.999531 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:11.000671 (+ 1140us) server_negotiation.cc:407] Connection header received
0619 06:38:11.002808 (+ 2137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:11.002814 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:11.002903 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:11.003034 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:11.005294 (+ 2260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:11.006389 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:11.009957 (+ 3568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:11.010536 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:11.010711 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:11.016476 (+ 5765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:11.016482 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:11.016485 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:11.016519 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:11.020417 (+ 3898us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:11.021546 (+ 1129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:11.021551 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:11.021553 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:11.021716 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:11.022437 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:11.022443 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:11.022446 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:11.022896 (+ 450us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:11.023057 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:11.024097 (+ 1040us) server_negotiation.cc:299] Negotiation successful
0619 06:38:11.024345 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":255,"threads_started":1}
I20260619 06:38:11.025869 12228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:10.999460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:40657 (local address 127.10.192.65:58239)
0619 06:38:11.000474 (+ 1014us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:11.000533 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:11.002484 (+ 1951us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:11.003301 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:11.003313 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:11.004085 (+ 772us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:11.005094 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:11.005132 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:11.006597 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:11.006606 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:11.009674 (+ 3068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:11.009699 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:11.010881 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:11.010893 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:11.011302 (+ 409us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:11.012286 (+ 984us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:11.012331 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:11.016153 (+ 3822us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:11.020610 (+ 4457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:11.020625 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:11.020657 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:11.021363 (+ 706us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:11.021873 (+ 510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:11.021879 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:11.021885 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:11.022236 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:11.023062 (+ 826us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:11.023077 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:11.023568 (+ 491us) client_negotiation.cc:769] Sending connection context
0619 06:38:11.024006 (+ 438us) client_negotiation.cc:240] Negotiation successful
0619 06:38:11.024634 (+ 628us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":721,"thread_start_us":447,"threads_started":1}
I20260619 06:38:11.046444 12203 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:35117
I20260619 06:38:11.046507 12338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:35117 every 8 connection(s)
I20260619 06:38:11.048353 12203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:38:11.048840 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 12203
I20260619 06:38:11.049420 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:38:11.050264 11009 external_mini_cluster.cc:1428] Setting key 848218f5162a3fc2b84ff61df78dbd81
I20260619 06:38:11.051805 12339 heartbeater.cc:347] Connected to a master server at 127.10.192.126:40657
I20260619 06:38:11.052088 12339 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:11.052382 12309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:11.033519 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:40657 (local address 127.10.192.65:44911)
0619 06:38:11.034786 (+ 1267us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:11.034825 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:11.035019 (+ 194us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:11.035518 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:11.035527 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:11.036297 (+ 770us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:11.036795 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:11.036812 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:11.038392 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:11.038399 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:11.040475 (+ 2076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:11.040496 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:11.041787 (+ 1291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:11.041800 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:11.042042 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:11.043025 (+ 983us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:11.043050 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:11.044104 (+ 1054us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:11.048554 (+ 4450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:11.048560 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:11.048564 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:11.049213 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:11.049884 (+ 671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:11.049893 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:11.049900 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:11.050112 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:11.050913 (+ 801us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:11.050919 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:11.051161 (+ 242us) client_negotiation.cc:769] Sending connection context
0619 06:38:11.051325 (+ 164us) client_negotiation.cc:240] Negotiation successful
0619 06:38:11.051721 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1044,"thread_start_us":693,"threads_started":1}
I20260619 06:38:11.052606 12227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:11.033570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:44911 (local address 127.10.192.126:40657)
0619 06:38:11.033838 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:11.033848 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:11.034924 (+ 1076us) server_negotiation.cc:407] Connection header received
0619 06:38:11.035217 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:11.035223 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:11.035328 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:11.035448 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:11.036986 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:11.038204 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:11.040664 (+ 2460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:11.041505 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:11.041683 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:11.044353 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:11.044360 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:11.044366 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:11.044409 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:11.048344 (+ 3935us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:11.049448 (+ 1104us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:11.049457 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:11.049472 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:11.049703 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:11.050316 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:11.050325 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:11.050330 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:11.050729 (+ 399us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:11.050965 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:11.051980 (+ 1015us) server_negotiation.cc:299] Negotiation successful
0619 06:38:11.052227 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260619 06:38:11.052945 12339 heartbeater.cc:511] Master 127.10.192.126:40657 requested a full tablet report, sending...
I20260619 06:38:11.055532 12132 ts_manager.cc:194] Registered new tserver with Master: 778825b73dcb4c8abfa702b9de030d62 (127.10.192.65:35117)
I20260619 06:38:11.057232 12132 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:58239
WARNING: no policy specified for kudu/127.10.192.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
I20260619 06:38:11.094966 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:40657
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:35607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:11.420441 12343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:11.420740 12343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:11.420913 12343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:11.428892 12343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:11.429008 12343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:11.429203 12343 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 06:38:11.429358 12343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:38:11.439345 12343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:35607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.192.126:40657
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:11.440728 12343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:11.442112 12343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:11.455847 12348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:11.455816 12349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:11.456238 12351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:11.456792 12343 server_base.cc:1034] running on GCE node
I20260619 06:38:11.457506 12343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:11.458487 12343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:11.459794 12343 hybrid_clock.cc:648] HybridClock initialized: now 1781851091459718 us; error 44 us; skew 500 ppm
I20260619 06:38:11.460166 12343 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:11 dist-test-slave-7lz4 krb5kdc[12087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851091, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:11.467998 12343 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:38:11.469616 12343 webserver.cc:460] Webserver started at http://127.10.192.66:38535/ using document root <none> and password file <none>
I20260619 06:38:11.470417 12343 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:11.470551 12343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:11.470887 12343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:11.474269 12343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "3f6d326948844095ad4f44d712d3f386"
format_stamp: "Formatted at 2026-06-19 06:38:11 on dist-test-slave-7lz4"
server_key: "3e47ca8c727d56848b3f5593eb40c910"
server_key_iv: "1b51b26b47dbc6d1e8e0b3ffff920da8"
server_key_version: "encryptionkey@0"
I20260619 06:38:11.475091 12343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "3f6d326948844095ad4f44d712d3f386"
format_stamp: "Formatted at 2026-06-19 06:38:11 on dist-test-slave-7lz4"
server_key: "3e47ca8c727d56848b3f5593eb40c910"
server_key_iv: "1b51b26b47dbc6d1e8e0b3ffff920da8"
server_key_version: "encryptionkey@0"
I20260619 06:38:11.480782 12343 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260619 06:38:11.484473 12358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:11.485934 12343 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:38:11.486119 12343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "3f6d326948844095ad4f44d712d3f386"
format_stamp: "Formatted at 2026-06-19 06:38:11 on dist-test-slave-7lz4"
server_key: "3e47ca8c727d56848b3f5593eb40c910"
server_key_iv: "1b51b26b47dbc6d1e8e0b3ffff920da8"
server_key_version: "encryptionkey@0"
I20260619 06:38:11.486346 12343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:11.501037 12343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:11.505278 12343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:11.505570 12343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:11.508195 12343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:11.508315 12343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:11.508492 12343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:11.508577 12343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 06:38:11 dist-test-slave-7lz4 krb5kdc[12087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851091, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:11.533336 12227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:11.509051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:33971 (local address 127.10.192.126:40657)
0619 06:38:11.509238 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:11.509243 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:11.510726 (+ 1483us) server_negotiation.cc:407] Connection header received
0619 06:38:11.513061 (+ 2335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:11.513089 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:11.513199 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:11.513292 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:11.515974 (+ 2682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:11.516979 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:11.519547 (+ 2568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:11.520157 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:11.520329 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:11.525962 (+ 5633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:11.525972 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:11.525980 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:11.526030 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:11.529733 (+ 3703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:11.530536 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:11.530540 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:11.530543 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:11.530673 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:11.531137 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:11.531148 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:11.531151 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:11.531437 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:11.531605 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:11.532745 (+ 1140us) server_negotiation.cc:299] Negotiation successful
0619 06:38:11.532984 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 06:38:11.534457 12367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:11.509631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:40657 (local address 127.10.192.66:33971)
0619 06:38:11.510523 (+ 892us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:11.510580 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:11.512631 (+ 2051us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:11.513861 (+ 1230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:11.513887 (+ 26us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:11.514707 (+ 820us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:11.515728 (+ 1021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:11.515759 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:11.517122 (+ 1363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:11.517128 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:11.519363 (+ 2235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:11.519382 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:11.520537 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:11.520548 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:11.520925 (+ 377us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:11.521865 (+ 940us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:11.521902 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:11.525651 (+ 3749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:11.529896 (+ 4245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:11.529906 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:11.529926 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:11.530388 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:11.530791 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:11.530796 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:11.530799 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:11.531012 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:11.531578 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:11.531587 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:11.532210 (+ 623us) client_negotiation.cc:769] Sending connection context
0619 06:38:11.532640 (+ 430us) client_negotiation.cc:240] Negotiation successful
0619 06:38:11.533228 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":380,"threads_started":1}
I20260619 06:38:11.558239 12227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:11.541293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:58759 (local address 127.10.192.126:40657)
0619 06:38:11.541474 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:11.541478 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:11.542144 (+ 666us) server_negotiation.cc:407] Connection header received
0619 06:38:11.542544 (+ 400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:11.542550 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:11.542644 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:11.542768 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:11.544708 (+ 1940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:11.546008 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:11.548881 (+ 2873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:11.549322 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:11.549439 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:11.552276 (+ 2837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:11.552282 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:11.552287 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:11.552332 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:11.555125 (+ 2793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:11.556195 (+ 1070us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:11.556200 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:11.556202 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:11.556334 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:11.556791 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:11.556794 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:11.556796 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:11.557107 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:11.557264 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:11.557664 (+ 400us) server_negotiation.cc:299] Negotiation successful
0619 06:38:11.557879 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260619 06:38:11.558372 12431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:11.541412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:40657 (local address 127.10.192.66:58759)
0619 06:38:11.542029 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:11.542050 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:11.542261 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:11.542988 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:11.542992 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:11.543825 (+ 833us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:11.544470 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:11.544487 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:11.546199 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:11.546207 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:11.548682 (+ 2475us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:11.548706 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:11.549552 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:11.549560 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:11.549757 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:11.550539 (+ 782us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:11.550572 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:11.552019 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:11.555284 (+ 3265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:11.555292 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:11.555299 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:11.556057 (+ 758us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:11.556466 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:11.556474 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:11.556480 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:11.556668 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:11.557232 (+ 564us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:11.557237 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:11.557424 (+ 187us) client_negotiation.cc:769] Sending connection context
0619 06:38:11.557563 (+ 139us) client_negotiation.cc:240] Negotiation successful
0619 06:38:11.557900 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":327,"threads_started":1}
I20260619 06:38:11.569060 12343 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:40471
I20260619 06:38:11.569110 12477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:40471 every 8 connection(s)
I20260619 06:38:11.570501 12343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:38:11.572712 12478 heartbeater.cc:347] Connected to a master server at 127.10.192.126:40657
I20260619 06:38:11.572994 12478 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:11.573688 12478 heartbeater.cc:511] Master 127.10.192.126:40657 requested a full tablet report, sending...
I20260619 06:38:11.575086 12132 ts_manager.cc:194] Registered new tserver with Master: 3f6d326948844095ad4f44d712d3f386 (127.10.192.66:40471)
I20260619 06:38:11.576009 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 12343
I20260619 06:38:11.576047 12132 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:33971
I20260619 06:38:11.576215 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:38:11.576647 11009 external_mini_cluster.cc:1428] Setting key 146de0a658577caea1157fb9c16ae33a
WARNING: no policy specified for kudu/127.10.192.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
I20260619 06:38:11.618631 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:40657
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:35607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:11.950183 12482 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:11.950500 12482 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:11.950599 12482 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:11.958431 12482 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:11.958566 12482 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:11.958654 12482 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 06:38:11.958738 12482 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:38:11.969342 12482 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:35607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.192.126:40657
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:11.970692 12482 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:11.972084 12482 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:11.986538 12487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:11.986474 12490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:11.986500 12488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:11.992875 12482 server_base.cc:1034] running on GCE node
I20260619 06:38:11.993891 12482 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:11.994944 12482 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:11.996215 12482 hybrid_clock.cc:648] HybridClock initialized: now 1781851091996128 us; error 68 us; skew 500 ppm
I20260619 06:38:11.996554 12482 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:11 dist-test-slave-7lz4 krb5kdc[12087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851091, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:12.000105 12482 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:38:12.001783 12482 webserver.cc:460] Webserver started at http://127.10.192.67:42695/ using document root <none> and password file <none>
I20260619 06:38:12.002583 12482 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:12.002720 12482 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:12.003062 12482 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:12.006230 12482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "f782309225c64440b10cf128df40e5cd"
format_stamp: "Formatted at 2026-06-19 06:38:11 on dist-test-slave-7lz4"
server_key: "b59cb954ce71dfca05242b721a09f938"
server_key_iv: "c4a497c7c7e32db98982b39c656d99e0"
server_key_version: "encryptionkey@0"
I20260619 06:38:12.007125 12482 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "f782309225c64440b10cf128df40e5cd"
format_stamp: "Formatted at 2026-06-19 06:38:11 on dist-test-slave-7lz4"
server_key: "b59cb954ce71dfca05242b721a09f938"
server_key_iv: "c4a497c7c7e32db98982b39c656d99e0"
server_key_version: "encryptionkey@0"
I20260619 06:38:12.012650 12482 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260619 06:38:12.016407 12497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:12.018044 12482 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:38:12.018240 12482 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "f782309225c64440b10cf128df40e5cd"
format_stamp: "Formatted at 2026-06-19 06:38:11 on dist-test-slave-7lz4"
server_key: "b59cb954ce71dfca05242b721a09f938"
server_key_iv: "c4a497c7c7e32db98982b39c656d99e0"
server_key_version: "encryptionkey@0"
I20260619 06:38:12.018496 12482 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:12.043080 12482 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:12.048851 12482 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:12.049226 12482 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:12.052809 12482 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:12.052932 12482 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:12.053057 12482 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:12.053139 12482 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:12.060779 12339 heartbeater.cc:503] Master 127.10.192.126:40657 was elected leader, sending a full tablet report...
Jun 19 06:38:12 dist-test-slave-7lz4 krb5kdc[12087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851091, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:12.080581 12227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.053382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:57395 (local address 127.10.192.126:40657)
0619 06:38:12.053590 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:12.053596 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:12.055163 (+ 1567us) server_negotiation.cc:407] Connection header received
0619 06:38:12.057398 (+ 2235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:12.057404 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:12.057505 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:12.057615 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:12.060299 (+ 2684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.061624 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.064222 (+ 2598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.064984 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.065147 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.070724 (+ 5577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:12.070733 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:12.070740 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:12.070784 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:12.074726 (+ 3942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:12.076074 (+ 1348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:12.076082 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:12.076086 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:12.076268 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:12.076971 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:12.076978 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:12.076985 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:12.077348 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:12.077532 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:12.079957 (+ 2425us) server_negotiation.cc:299] Negotiation successful
0619 06:38:12.080229 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260619 06:38:12.080932 12506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.054033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:40657 (local address 127.10.192.67:57395)
0619 06:38:12.054947 (+ 914us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:12.054999 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:12.057090 (+ 2091us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:12.058077 (+ 987us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:12.058086 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:12.058996 (+ 910us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:12.060058 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.060099 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.061857 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.061864 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.064073 (+ 2209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.064086 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.065288 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.065297 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.065548 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.066492 (+ 944us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:12.066515 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:12.070368 (+ 3853us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:12.074903 (+ 4535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:12.074917 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:12.074946 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:12.075882 (+ 936us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:12.076413 (+ 531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:12.076422 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:12.076426 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:12.076779 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:12.077611 (+ 832us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:12.077621 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:12.078099 (+ 478us) client_negotiation.cc:769] Sending connection context
0619 06:38:12.078487 (+ 388us) client_negotiation.cc:240] Negotiation successful
0619 06:38:12.079209 (+ 722us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":392,"threads_started":1}
I20260619 06:38:12.104715 12227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.087225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:40033 (local address 127.10.192.126:40657)
0619 06:38:12.087465 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:12.087474 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:12.088147 (+ 673us) server_negotiation.cc:407] Connection header received
0619 06:38:12.088399 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:12.088403 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:12.088485 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:12.088575 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:12.090177 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.090953 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.093823 (+ 2870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.094245 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.094361 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.097459 (+ 3098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:12.097470 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:12.097476 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:12.097529 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:12.100910 (+ 3381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:12.102221 (+ 1311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:12.102230 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:12.102237 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:12.102439 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:12.102988 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:12.102995 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:12.103000 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:12.103350 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:12.103533 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:12.104102 (+ 569us) server_negotiation.cc:299] Negotiation successful
0619 06:38:12.104333 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260619 06:38:12.104815 12579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.087197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:40657 (local address 127.10.192.67:40033)
0619 06:38:12.088013 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:12.088039 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:12.088236 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:12.088644 (+ 408us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:12.088652 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:12.089424 (+ 772us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:12.089927 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.089945 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.091118 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.091127 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.093618 (+ 2491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.093644 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.094474 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.094484 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.094738 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.095578 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:12.095611 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:12.097169 (+ 1558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:12.101162 (+ 3993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:12.101172 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:12.101176 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:12.102016 (+ 840us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:12.102594 (+ 578us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:12.102600 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:12.102610 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:12.102816 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:12.103484 (+ 668us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:12.103489 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:12.103738 (+ 249us) client_negotiation.cc:769] Sending connection context
0619 06:38:12.103994 (+ 256us) client_negotiation.cc:240] Negotiation successful
0619 06:38:12.104355 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":370,"threads_started":1}
I20260619 06:38:12.110828 12482 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:37949
I20260619 06:38:12.110846 12616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:37949 every 8 connection(s)
I20260619 06:38:12.112171 12482 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:38:12.114324 12617 heartbeater.cc:347] Connected to a master server at 127.10.192.126:40657
I20260619 06:38:12.114557 12617 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:12.115156 12617 heartbeater.cc:511] Master 127.10.192.126:40657 requested a full tablet report, sending...
I20260619 06:38:12.116524 12132 ts_manager.cc:194] Registered new tserver with Master: f782309225c64440b10cf128df40e5cd (127.10.192.67:37949)
I20260619 06:38:12.117421 12132 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:57395
I20260619 06:38:12.118091 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 12482
I20260619 06:38:12.118292 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:38:12.118718 11009 external_mini_cluster.cc:1428] Setting key 9fb6937ee45bf5e02f0e01583023d312
I20260619 06:38:12.121549 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 19 06:38:12 dist-test-slave-7lz4 krb5kdc[12087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851092, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 19 06:38:12 dist-test-slave-7lz4 krb5kdc[12087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851092, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:12.168561 12227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.153949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39046 (local address 127.10.192.126:40657)
0619 06:38:12.154128 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:12.154133 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:12.154493 (+ 360us) server_negotiation.cc:407] Connection header received
0619 06:38:12.154629 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:12.154633 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:12.154698 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:12.154794 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:12.156264 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.157042 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.159027 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.159624 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.159822 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.163575 (+ 3753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:12.163581 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:12.163585 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:12.163624 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:12.166200 (+ 2576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:12.166838 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:12.166841 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:12.166844 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:12.166962 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:12.167275 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:12.167278 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:12.167309 (+ 31us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:12.167585 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:12.167857 (+ 272us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:12.168096 (+ 239us) server_negotiation.cc:299] Negotiation successful
0619 06:38:12.168263 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260619 06:38:12.172827 12132 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39046:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:38:12.179955 12132 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:38:12.205117 12635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.194911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54188 (local address 127.10.192.67:37949)
0619 06:38:12.196961 (+ 2050us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:12.196967 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:12.196993 (+ 26us) server_negotiation.cc:407] Connection header received
0619 06:38:12.197063 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:12.197068 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:12.197233 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:12.197843 (+ 610us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:12.198421 (+ 578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.200092 (+ 1671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.202632 (+ 2540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.203917 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.204071 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.204338 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:12.204598 (+ 260us) server_negotiation.cc:299] Negotiation successful
0619 06:38:12.204771 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1910,"thread_start_us":1725,"threads_started":1}
I20260619 06:38:12.205325 12631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.193041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:35117 (local address 127.0.0.1:46598)
0619 06:38:12.193829 (+ 788us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:12.193855 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:12.194037 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:12.197406 (+ 3369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:12.197416 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:12.197444 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:12.198008 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.198040 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.200153 (+ 2113us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.200160 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.202197 (+ 2037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.202212 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.204468 (+ 2256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.204474 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.204643 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.204675 (+ 32us) client_negotiation.cc:769] Sending connection context
0619 06:38:12.204756 (+ 81us) client_negotiation.cc:240] Negotiation successful
0619 06:38:12.204909 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"mutex_wait_us":168,"spinlock_wait_cycles":10240,"thread_start_us":789,"threads_started":1}
I20260619 06:38:12.205350 12634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.194459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:37949 (local address 127.0.0.1:54188)
0619 06:38:12.194984 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:12.195007 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:12.195141 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:12.197433 (+ 2292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:12.197437 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:12.197453 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:12.198179 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.198197 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.200253 (+ 2056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.200260 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.202431 (+ 2171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.202459 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.204137 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.204143 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.204329 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.204384 (+ 55us) client_negotiation.cc:769] Sending connection context
0619 06:38:12.204554 (+ 170us) client_negotiation.cc:240] Negotiation successful
0619 06:38:12.204762 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"mutex_wait_us":81,"thread_start_us":251,"threads_started":1}
I20260619 06:38:12.206056 12633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.193676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46598 (local address 127.10.192.65:35117)
0619 06:38:12.196590 (+ 2914us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:12.196604 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:12.196644 (+ 40us) server_negotiation.cc:407] Connection header received
0619 06:38:12.196786 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:12.196798 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:12.197138 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:12.197395 (+ 257us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:12.198287 (+ 892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.200020 (+ 1733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.202438 (+ 2418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.204001 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.204132 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.204328 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:12.205581 (+ 1253us) server_negotiation.cc:299] Negotiation successful
0619 06:38:12.205752 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2695,"thread_start_us":2541,"threads_started":1}
I20260619 06:38:12.206924 12630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.192989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:40471 (local address 127.0.0.1:53046)
0619 06:38:12.193808 (+ 819us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:12.193854 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:12.194037 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:12.199138 (+ 5101us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:12.199143 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:12.199171 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:12.199544 (+ 373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.199556 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.201676 (+ 2120us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.201682 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.203930 (+ 2248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.203947 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.206089 (+ 2142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.206095 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.206258 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.206287 (+ 29us) client_negotiation.cc:769] Sending connection context
0619 06:38:12.206372 (+ 85us) client_negotiation.cc:240] Negotiation successful
0619 06:38:12.206530 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":508,"mutex_wait_us":58,"spinlock_wait_cycles":3328,"thread_start_us":661,"threads_started":1}
I20260619 06:38:12.208070 12632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.193511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53046 (local address 127.10.192.66:40471)
0619 06:38:12.198543 (+ 5032us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:12.198552 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:12.198579 (+ 27us) server_negotiation.cc:407] Connection header received
0619 06:38:12.198682 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:12.198690 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:12.198925 (+ 235us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:12.199794 (+ 869us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:12.200008 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.201523 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.204137 (+ 2614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.205886 (+ 1749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.206028 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.206244 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:12.207591 (+ 1347us) server_negotiation.cc:299] Negotiation successful
0619 06:38:12.207800 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4886,"thread_start_us":4747,"threads_started":1}
I20260619 06:38:12.209456 12269 tablet_service.cc:1467] Processing CreateTablet for tablet 18e6162ae07e4aeeb0bf51790bcc2ae3 (DEFAULT_TABLE table=test-table [id=1654fa3934ea4817ba6da63a8062013f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:12.209481 12547 tablet_service.cc:1467] Processing CreateTablet for tablet 18e6162ae07e4aeeb0bf51790bcc2ae3 (DEFAULT_TABLE table=test-table [id=1654fa3934ea4817ba6da63a8062013f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:12.210697 12269 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18e6162ae07e4aeeb0bf51790bcc2ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:12.210827 12547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18e6162ae07e4aeeb0bf51790bcc2ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:12.211336 12408 tablet_service.cc:1467] Processing CreateTablet for tablet 18e6162ae07e4aeeb0bf51790bcc2ae3 (DEFAULT_TABLE table=test-table [id=1654fa3934ea4817ba6da63a8062013f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:12.212719 12408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 18e6162ae07e4aeeb0bf51790bcc2ae3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:12.222167 12636 tablet_bootstrap.cc:492] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62: Bootstrap starting.
I20260619 06:38:12.225474 12636 tablet_bootstrap.cc:654] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:12.226961 12636 log.cc:824] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:12.227353 12638 tablet_bootstrap.cc:492] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386: Bootstrap starting.
I20260619 06:38:12.231943 12638 tablet_bootstrap.cc:654] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:12.232156 12637 tablet_bootstrap.cc:492] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd: Bootstrap starting.
I20260619 06:38:12.233275 12638 log.cc:824] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:12.235188 12636 tablet_bootstrap.cc:492] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62: No bootstrap required, opened a new log
I20260619 06:38:12.235561 12636 ts_tablet_manager.cc:1397] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.008s
I20260619 06:38:12.235956 12637 tablet_bootstrap.cc:654] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:12.236557 12638 tablet_bootstrap.cc:492] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386: No bootstrap required, opened a new log
I20260619 06:38:12.236817 12638 ts_tablet_manager.cc:1397] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260619 06:38:12.237344 12637 log.cc:824] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:12.240506 12637 tablet_bootstrap.cc:492] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd: No bootstrap required, opened a new log
I20260619 06:38:12.240787 12637 ts_tablet_manager.cc:1397] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260619 06:38:12.243584 12636 raft_consensus.cc:348] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.244038 12636 raft_consensus.cc:374] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:12.244138 12636 raft_consensus.cc:729] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 778825b73dcb4c8abfa702b9de030d62, State: Initialized, Role: FOLLOWER
I20260619 06:38:12.244791 12636 consensus_queue.cc:260] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.247375 12638 raft_consensus.cc:348] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.247867 12638 raft_consensus.cc:374] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:12.247973 12638 raft_consensus.cc:729] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f6d326948844095ad4f44d712d3f386, State: Initialized, Role: FOLLOWER
I20260619 06:38:12.248493 12636 ts_tablet_manager.cc:1428] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62: Time spent starting tablet: real 0.013s user 0.008s sys 0.004s
I20260619 06:38:12.248678 12638 consensus_queue.cc:260] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.250402 12638 ts_tablet_manager.cc:1428] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386: Time spent starting tablet: real 0.013s user 0.010s sys 0.004s
I20260619 06:38:12.250485 12478 heartbeater.cc:503] Master 127.10.192.126:40657 was elected leader, sending a full tablet report...
I20260619 06:38:12.251417 12637 raft_consensus.cc:348] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.251960 12637 raft_consensus.cc:374] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:12.252064 12637 raft_consensus.cc:729] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f782309225c64440b10cf128df40e5cd, State: Initialized, Role: FOLLOWER
I20260619 06:38:12.252700 12637 consensus_queue.cc:260] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.254026 12617 heartbeater.cc:503] Master 127.10.192.126:40657 was elected leader, sending a full tablet report...
I20260619 06:38:12.254561 12637 ts_tablet_manager.cc:1428] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd: Time spent starting tablet: real 0.014s user 0.011s sys 0.003s
W20260619 06:38:12.302333 12340 tablet.cc:2369] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:38:12.317051 12643 raft_consensus.cc:482] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:38:12.317353 12643 raft_consensus.cc:504] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.319217 12643 leader_election.cc:288] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 778825b73dcb4c8abfa702b9de030d62 (127.10.192.65:35117), f782309225c64440b10cf128df40e5cd (127.10.192.67:37949)
W20260619 06:38:12.322530 12479 tablet.cc:2369] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:38:12.326898 12635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.319867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:34855 (local address 127.10.192.67:37949)
0619 06:38:12.320187 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:12.320196 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:12.321256 (+ 1060us) server_negotiation.cc:407] Connection header received
0619 06:38:12.321380 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:12.321385 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:12.321459 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:12.321545 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:12.322334 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.323227 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.325166 (+ 1939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.325924 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.326123 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.326204 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:12.326518 (+ 314us) server_negotiation.cc:299] Negotiation successful
0619 06:38:12.326639 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260619 06:38:12.326924 12633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.319848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:42417 (local address 127.10.192.65:35117)
0619 06:38:12.320067 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:12.320073 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:12.321091 (+ 1018us) server_negotiation.cc:407] Connection header received
0619 06:38:12.321312 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:12.321320 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:12.321416 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:12.321519 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:12.322309 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.323375 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.325197 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.325963 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.326163 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.326241 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:12.326535 (+ 294us) server_negotiation.cc:299] Negotiation successful
0619 06:38:12.326664 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 06:38:12.327064 12645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.319493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:35117 (local address 127.10.192.66:42417)
0619 06:38:12.320931 (+ 1438us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:12.320959 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:12.321129 (+ 170us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:12.321570 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:12.321575 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:12.321601 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:12.322101 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.322119 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.323490 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.323497 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.325034 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.325047 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.326210 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.326216 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.326382 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.326403 (+ 21us) client_negotiation.cc:769] Sending connection context
0619 06:38:12.326508 (+ 105us) client_negotiation.cc:240] Negotiation successful
0619 06:38:12.326640 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1233,"mutex_wait_us":26,"thread_start_us":940,"threads_started":1}
I20260619 06:38:12.327508 12646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.319487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:37949 (local address 127.10.192.66:34855)
0619 06:38:12.321152 (+ 1665us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:12.321166 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:12.321268 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:12.321570 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:12.321575 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:12.321661 (+ 86us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:12.322143 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.322152 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.323416 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.323420 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.325007 (+ 1587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.325023 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.326173 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.326180 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.326341 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.326365 (+ 24us) client_negotiation.cc:769] Sending connection context
0619 06:38:12.326475 (+ 110us) client_negotiation.cc:240] Negotiation successful
0619 06:38:12.326614 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1551,"mutex_wait_us":683,"spinlock_wait_cycles":25472,"thread_start_us":644,"threads_started":1}
I20260619 06:38:12.328104 12289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e6162ae07e4aeeb0bf51790bcc2ae3" candidate_uuid: "3f6d326948844095ad4f44d712d3f386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "778825b73dcb4c8abfa702b9de030d62" is_pre_election: true
I20260619 06:38:12.328450 12567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e6162ae07e4aeeb0bf51790bcc2ae3" candidate_uuid: "3f6d326948844095ad4f44d712d3f386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f782309225c64440b10cf128df40e5cd" is_pre_election: true
I20260619 06:38:12.328599 12289 raft_consensus.cc:2454] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f6d326948844095ad4f44d712d3f386 in term 0.
I20260619 06:38:12.328927 12567 raft_consensus.cc:2454] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f6d326948844095ad4f44d712d3f386 in term 0.
I20260619 06:38:12.329308 12361 leader_election.cc:302] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f6d326948844095ad4f44d712d3f386, 778825b73dcb4c8abfa702b9de030d62; no voters:
I20260619 06:38:12.329694 12643 raft_consensus.cc:2781] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:38:12.329841 12643 raft_consensus.cc:482] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:38:12.329945 12643 raft_consensus.cc:3037] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:12.332183 12643 raft_consensus.cc:504] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.332809 12643 leader_election.cc:288] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [CANDIDATE]: Term 1 election: Requested vote from peers 778825b73dcb4c8abfa702b9de030d62 (127.10.192.65:35117), f782309225c64440b10cf128df40e5cd (127.10.192.67:37949)
I20260619 06:38:12.333287 12289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e6162ae07e4aeeb0bf51790bcc2ae3" candidate_uuid: "3f6d326948844095ad4f44d712d3f386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "778825b73dcb4c8abfa702b9de030d62"
I20260619 06:38:12.333406 12567 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e6162ae07e4aeeb0bf51790bcc2ae3" candidate_uuid: "3f6d326948844095ad4f44d712d3f386" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f782309225c64440b10cf128df40e5cd"
I20260619 06:38:12.333519 12289 raft_consensus.cc:3037] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:12.333614 12567 raft_consensus.cc:3037] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:12.336882 12567 raft_consensus.cc:2454] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f6d326948844095ad4f44d712d3f386 in term 1.
I20260619 06:38:12.336882 12289 raft_consensus.cc:2454] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f6d326948844095ad4f44d712d3f386 in term 1.
I20260619 06:38:12.337407 12361 leader_election.cc:302] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 3f6d326948844095ad4f44d712d3f386, 778825b73dcb4c8abfa702b9de030d62, f782309225c64440b10cf128df40e5cd; no voters:
I20260619 06:38:12.337738 12643 raft_consensus.cc:2781] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:12.338186 12643 raft_consensus.cc:686] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [term 1 LEADER]: Becoming Leader. State: Replica: 3f6d326948844095ad4f44d712d3f386, State: Running, Role: LEADER
I20260619 06:38:12.338725 12643 consensus_queue.cc:237] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.343307 12131 catalog_manager.cc:5495] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f6d326948844095ad4f44d712d3f386 (127.10.192.66). New cstate: current_term: 1 leader_uuid: "3f6d326948844095ad4f44d712d3f386" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } health_report { overall_health: UNKNOWN } } }
W20260619 06:38:12.363822 12618 tablet.cc:2369] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:38:12.368667 12632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.363036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53048 (local address 127.10.192.66:40471)
0619 06:38:12.363247 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:12.363251 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:12.363438 (+ 187us) server_negotiation.cc:407] Connection header received
0619 06:38:12.363813 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:12.363819 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:12.363949 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:12.364113 (+ 164us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:38:12.364492 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.365268 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.366554 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.366979 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.367071 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.367556 (+ 485us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:38:12.368177 (+ 621us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:38:12.368283 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:12.368397 (+ 114us) server_negotiation.cc:299] Negotiation successful
0619 06:38:12.368466 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260619 06:38:12.377162 12289 raft_consensus.cc:1261] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62 [term 1 FOLLOWER]: Refusing update from remote peer 3f6d326948844095ad4f44d712d3f386: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:12.377162 12567 raft_consensus.cc:1261] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd [term 1 FOLLOWER]: Refusing update from remote peer 3f6d326948844095ad4f44d712d3f386: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:12.378191 12647 consensus_queue.cc:1035] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:12.378616 12643 consensus_queue.cc:1035] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:12.391252 12650 mvcc.cc:205] Tried to move back new op lower bound from 7298462074366701568 to 7298462074223673344. Current Snapshot: MvccSnapshot[applied={T|T < 7298462074366701568}]
I20260619 06:38:12.393280 12652 mvcc.cc:205] Tried to move back new op lower bound from 7298462074366701568 to 7298462074223673344. Current Snapshot: MvccSnapshot[applied={T|T < 7298462074366701568}]
I20260619 06:38:12.399556 12651 mvcc.cc:205] Tried to move back new op lower bound from 7298462074366701568 to 7298462074223673344. Current Snapshot: MvccSnapshot[applied={T|T < 7298462074366701568}]
I20260619 06:38:12.413527 12131 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:38:12.413856 12131 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:38:12.417765 12131 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24: Sending DeleteTablet for 3 replicas of tablet 18e6162ae07e4aeeb0bf51790bcc2ae3
I20260619 06:38:12.419168 12408 tablet_service.cc:1514] Processing DeleteTablet for tablet 18e6162ae07e4aeeb0bf51790bcc2ae3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:12 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:53046
I20260619 06:38:12.419169 12269 tablet_service.cc:1514] Processing DeleteTablet for tablet 18e6162ae07e4aeeb0bf51790bcc2ae3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:12 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:46598
I20260619 06:38:12.419921 12547 tablet_service.cc:1514] Processing DeleteTablet for tablet 18e6162ae07e4aeeb0bf51790bcc2ae3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:12 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:54188
I20260619 06:38:12.420883 12131 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39046:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:38:12.421684 12131 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:38:12.424612 12661 tablet_replica.cc:330] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd: stopping tablet replica
I20260619 06:38:12.425107 12661 raft_consensus.cc:2229] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:12.425612 12661 raft_consensus.cc:2258] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:12.428189 12662 tablet_replica.cc:330] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386: stopping tablet replica
I20260619 06:38:12.428759 12662 raft_consensus.cc:2229] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:38:12.429929 12268 tablet_service.cc:1467] Processing CreateTablet for tablet a415116bc74546269d36a08530d0cee7 (DEFAULT_TABLE table=test-table [id=350f9fd226854af1b209baeef46ee2b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:12.429859 12407 tablet_service.cc:1467] Processing CreateTablet for tablet a415116bc74546269d36a08530d0cee7 (DEFAULT_TABLE table=test-table [id=350f9fd226854af1b209baeef46ee2b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:12.430547 12268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a415116bc74546269d36a08530d0cee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:12.430641 12662 raft_consensus.cc:2258] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:12.430635 12547 tablet_service.cc:1467] Processing CreateTablet for tablet a415116bc74546269d36a08530d0cee7 (DEFAULT_TABLE table=test-table [id=350f9fd226854af1b209baeef46ee2b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:12.430832 12407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a415116bc74546269d36a08530d0cee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:12.431087 12547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a415116bc74546269d36a08530d0cee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:12.434083 12661 ts_tablet_manager.cc:1905] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:12.437592 12662 ts_tablet_manager.cc:1905] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:12.437597 12638 tablet_bootstrap.cc:492] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386: Bootstrap starting.
I20260619 06:38:12.437659 12637 tablet_bootstrap.cc:492] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd: Bootstrap starting.
I20260619 06:38:12.439617 12638 tablet_bootstrap.cc:654] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:12.439658 12637 tablet_bootstrap.cc:654] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:12.442974 12660 tablet_replica.cc:330] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62: stopping tablet replica
I20260619 06:38:12.444031 12660 raft_consensus.cc:2229] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:12.444684 12660 raft_consensus.cc:2258] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:12.446012 12636 tablet_bootstrap.cc:492] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62: Bootstrap starting.
I20260619 06:38:12.447166 12660 ts_tablet_manager.cc:1905] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:12.447713 12636 tablet_bootstrap.cc:654] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:12.455360 12660 ts_tablet_manager.cc:1918] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:38:12.455657 12660 log.cc:1196] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/18e6162ae07e4aeeb0bf51790bcc2ae3
I20260619 06:38:12.456424 12660 ts_tablet_manager.cc:1939] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 778825b73dcb4c8abfa702b9de030d62: Deleting consensus metadata
I20260619 06:38:12.458815 12118 catalog_manager.cc:4841] TS 778825b73dcb4c8abfa702b9de030d62 (127.10.192.65:35117): tablet 18e6162ae07e4aeeb0bf51790bcc2ae3 (table test-table [id=1654fa3934ea4817ba6da63a8062013f]) successfully deleted
I20260619 06:38:12.461649 12661 ts_tablet_manager.cc:1918] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:38:12.461831 12661 log.cc:1196] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/18e6162ae07e4aeeb0bf51790bcc2ae3
I20260619 06:38:12.464111 12661 ts_tablet_manager.cc:1939] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P f782309225c64440b10cf128df40e5cd: Deleting consensus metadata
I20260619 06:38:12.465667 12636 tablet_bootstrap.cc:492] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62: No bootstrap required, opened a new log
I20260619 06:38:12.465816 12636 ts_tablet_manager.cc:1397] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62: Time spent bootstrapping tablet: real 0.020s user 0.010s sys 0.000s
I20260619 06:38:12.466094 12116 catalog_manager.cc:4841] TS f782309225c64440b10cf128df40e5cd (127.10.192.67:37949): tablet 18e6162ae07e4aeeb0bf51790bcc2ae3 (table test-table [id=1654fa3934ea4817ba6da63a8062013f]) successfully deleted
I20260619 06:38:12.466562 12636 raft_consensus.cc:348] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.466786 12636 raft_consensus.cc:374] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:12.466876 12636 raft_consensus.cc:729] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 778825b73dcb4c8abfa702b9de030d62, State: Initialized, Role: FOLLOWER
I20260619 06:38:12.467142 12636 consensus_queue.cc:260] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.467464 12637 tablet_bootstrap.cc:492] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd: No bootstrap required, opened a new log
I20260619 06:38:12.467604 12637 ts_tablet_manager.cc:1397] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd: Time spent bootstrapping tablet: real 0.030s user 0.010s sys 0.017s
I20260619 06:38:12.467716 12636 ts_tablet_manager.cc:1428] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 06:38:12.467250 12662 ts_tablet_manager.cc:1918] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:38:12.468295 12662 log.cc:1196] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/18e6162ae07e4aeeb0bf51790bcc2ae3
I20260619 06:38:12.468415 12637 raft_consensus.cc:348] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.468672 12637 raft_consensus.cc:374] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:12.468773 12637 raft_consensus.cc:729] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f782309225c64440b10cf128df40e5cd, State: Initialized, Role: FOLLOWER
I20260619 06:38:12.469131 12662 ts_tablet_manager.cc:1939] T 18e6162ae07e4aeeb0bf51790bcc2ae3 P 3f6d326948844095ad4f44d712d3f386: Deleting consensus metadata
I20260619 06:38:12.469050 12637 consensus_queue.cc:260] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.469712 12637 ts_tablet_manager.cc:1428] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260619 06:38:12.470703 12638 tablet_bootstrap.cc:492] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386: No bootstrap required, opened a new log
I20260619 06:38:12.470865 12638 ts_tablet_manager.cc:1397] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.007s
I20260619 06:38:12.471541 12116 catalog_manager.cc:4841] TS 3f6d326948844095ad4f44d712d3f386 (127.10.192.66:40471): tablet 18e6162ae07e4aeeb0bf51790bcc2ae3 (table test-table [id=1654fa3934ea4817ba6da63a8062013f]) successfully deleted
I20260619 06:38:12.472482 12638 raft_consensus.cc:348] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.472846 12638 raft_consensus.cc:374] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:12.472997 12638 raft_consensus.cc:729] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f6d326948844095ad4f44d712d3f386, State: Initialized, Role: FOLLOWER
I20260619 06:38:12.473300 12638 consensus_queue.cc:260] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.473968 12638 ts_tablet_manager.cc:1428] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 06:38:12.677961 12642 raft_consensus.cc:482] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:38:12.678257 12642 raft_consensus.cc:504] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.680368 12642 leader_election.cc:288] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f6d326948844095ad4f44d712d3f386 (127.10.192.66:40471), f782309225c64440b10cf128df40e5cd (127.10.192.67:37949)
I20260619 06:38:12.688324 12632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.680857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:44559 (local address 127.10.192.66:40471)
0619 06:38:12.681046 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:12.681052 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:12.681317 (+ 265us) server_negotiation.cc:407] Connection header received
0619 06:38:12.681690 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:12.681704 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:12.681813 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:12.681885 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:12.682727 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.684047 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.686033 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.687134 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.687304 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.687379 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:12.687785 (+ 406us) server_negotiation.cc:299] Negotiation successful
0619 06:38:12.687981 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 06:38:12.688392 12666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.680636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:40471 (local address 127.10.192.65:44559)
0619 06:38:12.681214 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:12.681236 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:12.681439 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:12.682088 (+ 649us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:12.682091 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:12.682112 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:12.682515 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.682527 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.684193 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.684201 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.685863 (+ 1662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.685876 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.687352 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.687358 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.687557 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.687597 (+ 40us) client_negotiation.cc:769] Sending connection context
0619 06:38:12.687723 (+ 126us) client_negotiation.cc:240] Negotiation successful
0619 06:38:12.687879 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"mutex_wait_us":105,"thread_start_us":284,"threads_started":1}
I20260619 06:38:12.689519 12635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.681511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:43739 (local address 127.10.192.67:37949)
0619 06:38:12.681673 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:12.681679 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:12.682289 (+ 610us) server_negotiation.cc:407] Connection header received
0619 06:38:12.682465 (+ 176us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:12.682471 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:12.682554 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:12.682638 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:12.683218 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.684109 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.686799 (+ 2690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.687994 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.688150 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.688217 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:12.689112 (+ 895us) server_negotiation.cc:299] Negotiation successful
0619 06:38:12.689269 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260619 06:38:12.689376 12433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a415116bc74546269d36a08530d0cee7" candidate_uuid: "778825b73dcb4c8abfa702b9de030d62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f6d326948844095ad4f44d712d3f386" is_pre_election: true
I20260619 06:38:12.689613 12667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.681364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:37949 (local address 127.10.192.65:43739)
0619 06:38:12.682148 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:12.682175 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:12.682319 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:12.682708 (+ 389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:12.682712 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:12.682735 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:12.683066 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.683074 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.684251 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.684257 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.686553 (+ 2296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.686568 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.688818 (+ 2250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.688827 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.688952 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.688975 (+ 23us) client_negotiation.cc:769] Sending connection context
0619 06:38:12.689085 (+ 110us) client_negotiation.cc:240] Negotiation successful
0619 06:38:12.689217 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"mutex_wait_us":22,"thread_start_us":456,"threads_started":1}
I20260619 06:38:12.689837 12433 raft_consensus.cc:2454] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 778825b73dcb4c8abfa702b9de030d62 in term 0.
I20260619 06:38:12.690194 12566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a415116bc74546269d36a08530d0cee7" candidate_uuid: "778825b73dcb4c8abfa702b9de030d62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f782309225c64440b10cf128df40e5cd" is_pre_election: true
I20260619 06:38:12.690450 12566 raft_consensus.cc:2454] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 778825b73dcb4c8abfa702b9de030d62 in term 0.
I20260619 06:38:12.690518 12219 leader_election.cc:302] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f6d326948844095ad4f44d712d3f386, 778825b73dcb4c8abfa702b9de030d62; no voters:
I20260619 06:38:12.690963 12642 raft_consensus.cc:2781] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:38:12.691092 12642 raft_consensus.cc:482] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:38:12.691195 12642 raft_consensus.cc:3037] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:12.693392 12642 raft_consensus.cc:504] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.694017 12642 leader_election.cc:288] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [CANDIDATE]: Term 1 election: Requested vote from peers 3f6d326948844095ad4f44d712d3f386 (127.10.192.66:40471), f782309225c64440b10cf128df40e5cd (127.10.192.67:37949)
I20260619 06:38:12.694629 12433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a415116bc74546269d36a08530d0cee7" candidate_uuid: "778825b73dcb4c8abfa702b9de030d62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f6d326948844095ad4f44d712d3f386"
I20260619 06:38:12.694679 12566 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a415116bc74546269d36a08530d0cee7" candidate_uuid: "778825b73dcb4c8abfa702b9de030d62" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f782309225c64440b10cf128df40e5cd"
I20260619 06:38:12.694868 12566 raft_consensus.cc:3037] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:12.694867 12433 raft_consensus.cc:3037] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:12.697960 12566 raft_consensus.cc:2454] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 778825b73dcb4c8abfa702b9de030d62 in term 1.
I20260619 06:38:12.698287 12433 raft_consensus.cc:2454] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 778825b73dcb4c8abfa702b9de030d62 in term 1.
I20260619 06:38:12.698546 12219 leader_election.cc:302] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 778825b73dcb4c8abfa702b9de030d62, f782309225c64440b10cf128df40e5cd; no voters:
I20260619 06:38:12.698855 12642 raft_consensus.cc:2781] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:12.699395 12642 raft_consensus.cc:686] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [term 1 LEADER]: Becoming Leader. State: Replica: 778825b73dcb4c8abfa702b9de030d62, State: Running, Role: LEADER
I20260619 06:38:12.700074 12642 consensus_queue.cc:237] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.710975 12131 catalog_manager.cc:5495] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 reported cstate change: term changed from 0 to 1, leader changed from <none> to 778825b73dcb4c8abfa702b9de030d62 (127.10.192.65). New cstate: current_term: 1 leader_uuid: "778825b73dcb4c8abfa702b9de030d62" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } health_report { overall_health: UNKNOWN } } }
Jun 19 06:38:12 dist-test-slave-7lz4 krb5kdc[12087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851090, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:12.774652 12675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.758202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:40657 (local address 127.0.0.1:39054)
0619 06:38:12.758947 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:12.758976 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:12.759168 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:12.759667 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:12.759673 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:12.760685 (+ 1012us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:12.760941 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.760954 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.762085 (+ 1131us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.762091 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.763594 (+ 1503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.763609 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.764357 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.764364 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.764547 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.765307 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:12.765332 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:12.768294 (+ 2962us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:12.771566 (+ 3272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:12.771581 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:12.771589 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:12.772247 (+ 658us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:12.772626 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:12.772631 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:12.772634 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:12.772822 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:12.773430 (+ 608us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:12.773441 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:12.773658 (+ 217us) client_negotiation.cc:769] Sending connection context
0619 06:38:12.773856 (+ 198us) client_negotiation.cc:240] Negotiation successful
0619 06:38:12.774194 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"thread_start_us":350,"threads_started":1}
I20260619 06:38:12.774660 12676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.758238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39054 (local address 127.10.192.126:40657)
0619 06:38:12.759326 (+ 1088us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:12.759330 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:12.759349 (+ 19us) server_negotiation.cc:407] Connection header received
0619 06:38:12.759392 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:12.759395 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:12.759449 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:12.759537 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:12.761136 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.761917 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.763769 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.764171 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.764265 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.768508 (+ 4243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:12.768512 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:12.768516 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:12.768546 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:12.771419 (+ 2873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:12.772382 (+ 963us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:12.772386 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:12.772388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:12.772510 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:12.772955 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:12.772959 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:12.772961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:12.773294 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:12.773404 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:12.773978 (+ 574us) server_negotiation.cc:299] Negotiation successful
0619 06:38:12.774360 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":171,"server-negotiator.queue_time_us":992,"thread_start_us":862,"threads_started":1}
I20260619 06:38:12.781293 12131 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:39054:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260619 06:38:12.782555 12131 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:38:12.790339 12268 tablet_service.cc:1467] Processing CreateTablet for tablet 3fa820040968408ab7916b986381eec3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=90902fb7755b4885be6149d80259d6ec]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 06:38:12.790475 12547 tablet_service.cc:1467] Processing CreateTablet for tablet 3fa820040968408ab7916b986381eec3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=90902fb7755b4885be6149d80259d6ec]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 06:38:12.790946 12268 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fa820040968408ab7916b986381eec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:12.791064 12547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fa820040968408ab7916b986381eec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:12.796294 12407 tablet_service.cc:1467] Processing CreateTablet for tablet 3fa820040968408ab7916b986381eec3 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=90902fb7755b4885be6149d80259d6ec]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 06:38:12.796818 12407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fa820040968408ab7916b986381eec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:12.798709 12637 tablet_bootstrap.cc:492] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd: Bootstrap starting.
I20260619 06:38:12.800565 12637 tablet_bootstrap.cc:654] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:12.804682 12637 tablet_bootstrap.cc:492] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd: No bootstrap required, opened a new log
I20260619 06:38:12.804865 12637 ts_tablet_manager.cc:1397] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s
I20260619 06:38:12.805379 12636 tablet_bootstrap.cc:492] T 3fa820040968408ab7916b986381eec3 P 778825b73dcb4c8abfa702b9de030d62: Bootstrap starting.
I20260619 06:38:12.805657 12637 raft_consensus.cc:348] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.805888 12637 raft_consensus.cc:374] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:12.805979 12637 raft_consensus.cc:729] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f782309225c64440b10cf128df40e5cd, State: Initialized, Role: FOLLOWER
I20260619 06:38:12.806258 12637 consensus_queue.cc:260] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.806685 12644 tablet_replica.cc:439] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } } }
I20260619 06:38:12.806975 12644 tablet_replica.cc:442] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:38:12.807075 12638 tablet_bootstrap.cc:492] T 3fa820040968408ab7916b986381eec3 P 3f6d326948844095ad4f44d712d3f386: Bootstrap starting.
I20260619 06:38:12.807273 12636 tablet_bootstrap.cc:654] T 3fa820040968408ab7916b986381eec3 P 778825b73dcb4c8abfa702b9de030d62: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:12.808848 12638 tablet_bootstrap.cc:654] T 3fa820040968408ab7916b986381eec3 P 3f6d326948844095ad4f44d712d3f386: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:12.809979 12637 ts_tablet_manager.cc:1428] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s
I20260619 06:38:12.814410 12636 tablet_bootstrap.cc:492] T 3fa820040968408ab7916b986381eec3 P 778825b73dcb4c8abfa702b9de030d62: No bootstrap required, opened a new log
I20260619 06:38:12.814633 12636 ts_tablet_manager.cc:1397] T 3fa820040968408ab7916b986381eec3 P 778825b73dcb4c8abfa702b9de030d62: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.002s
I20260619 06:38:12.815598 12636 raft_consensus.cc:348] T 3fa820040968408ab7916b986381eec3 P 778825b73dcb4c8abfa702b9de030d62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.815920 12636 raft_consensus.cc:374] T 3fa820040968408ab7916b986381eec3 P 778825b73dcb4c8abfa702b9de030d62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:12.816006 12636 raft_consensus.cc:729] T 3fa820040968408ab7916b986381eec3 P 778825b73dcb4c8abfa702b9de030d62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 778825b73dcb4c8abfa702b9de030d62, State: Initialized, Role: FOLLOWER
I20260619 06:38:12.816258 12636 consensus_queue.cc:260] T 3fa820040968408ab7916b986381eec3 P 778825b73dcb4c8abfa702b9de030d62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.816681 12642 tablet_replica.cc:439] T 3fa820040968408ab7916b986381eec3 P 778825b73dcb4c8abfa702b9de030d62: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } } }
I20260619 06:38:12.816968 12642 tablet_replica.cc:442] T 3fa820040968408ab7916b986381eec3 P 778825b73dcb4c8abfa702b9de030d62: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:38:12.817430 12638 tablet_bootstrap.cc:492] T 3fa820040968408ab7916b986381eec3 P 3f6d326948844095ad4f44d712d3f386: No bootstrap required, opened a new log
I20260619 06:38:12.817572 12636 ts_tablet_manager.cc:1428] T 3fa820040968408ab7916b986381eec3 P 778825b73dcb4c8abfa702b9de030d62: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260619 06:38:12.817706 12638 ts_tablet_manager.cc:1397] T 3fa820040968408ab7916b986381eec3 P 3f6d326948844095ad4f44d712d3f386: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20260619 06:38:12.818426 12638 raft_consensus.cc:348] T 3fa820040968408ab7916b986381eec3 P 3f6d326948844095ad4f44d712d3f386 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.818727 12638 raft_consensus.cc:374] T 3fa820040968408ab7916b986381eec3 P 3f6d326948844095ad4f44d712d3f386 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:12.818823 12638 raft_consensus.cc:729] T 3fa820040968408ab7916b986381eec3 P 3f6d326948844095ad4f44d712d3f386 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f6d326948844095ad4f44d712d3f386, State: Initialized, Role: FOLLOWER
I20260619 06:38:12.819142 12638 consensus_queue.cc:260] T 3fa820040968408ab7916b986381eec3 P 3f6d326948844095ad4f44d712d3f386 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.819589 12647 tablet_replica.cc:439] T 3fa820040968408ab7916b986381eec3 P 3f6d326948844095ad4f44d712d3f386: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } } }
I20260619 06:38:12.819993 12647 tablet_replica.cc:442] T 3fa820040968408ab7916b986381eec3 P 3f6d326948844095ad4f44d712d3f386: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:38:12.821000 12638 ts_tablet_manager.cc:1428] T 3fa820040968408ab7916b986381eec3 P 3f6d326948844095ad4f44d712d3f386: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260619 06:38:12.848852 12644 raft_consensus.cc:482] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:38:12.849109 12644 raft_consensus.cc:504] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.850751 12644 leader_election.cc:288] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 778825b73dcb4c8abfa702b9de030d62 (127.10.192.65:35117), 3f6d326948844095ad4f44d712d3f386 (127.10.192.66:40471)
I20260619 06:38:12.859077 12682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.851753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:32981 (local address 127.10.192.65:35117)
0619 06:38:12.852633 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:12.852640 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:12.852660 (+ 20us) server_negotiation.cc:407] Connection header received
0619 06:38:12.852736 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:12.852743 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:12.852826 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:12.852958 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:12.853590 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.854828 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.857179 (+ 2351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.857998 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.858210 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.858294 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:12.858639 (+ 345us) server_negotiation.cc:299] Negotiation successful
0619 06:38:12.858777 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":752,"thread_start_us":918,"threads_started":1}
I20260619 06:38:12.859104 12680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.850909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:35117 (local address 127.10.192.67:32981)
0619 06:38:12.851681 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:12.851701 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:12.851840 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:12.852997 (+ 1157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:12.853002 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:12.853024 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:12.853378 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.853396 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.854981 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.854989 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.857035 (+ 2046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.857045 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.858211 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.858216 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.858440 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.858485 (+ 45us) client_negotiation.cc:769] Sending connection context
0619 06:38:12.858591 (+ 106us) client_negotiation.cc:240] Negotiation successful
0619 06:38:12.858741 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"thread_start_us":427,"threads_started":1}
I20260619 06:38:12.860076 12289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fa820040968408ab7916b986381eec3" candidate_uuid: "f782309225c64440b10cf128df40e5cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "778825b73dcb4c8abfa702b9de030d62" is_pre_election: true
I20260619 06:38:12.860351 12289 raft_consensus.cc:2454] T 3fa820040968408ab7916b986381eec3 P 778825b73dcb4c8abfa702b9de030d62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f782309225c64440b10cf128df40e5cd in term 0.
I20260619 06:38:12.860639 12681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.851022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:40471 (local address 127.10.192.67:52309)
0619 06:38:12.852433 (+ 1411us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:12.852463 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:12.852631 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:12.853138 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:12.853144 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:12.853163 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:12.853534 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.853546 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.854610 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.854618 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.856832 (+ 2214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.856850 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.858904 (+ 2054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.858911 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.859115 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.859152 (+ 37us) client_negotiation.cc:769] Sending connection context
0619 06:38:12.859956 (+ 804us) client_negotiation.cc:240] Negotiation successful
0619 06:38:12.860107 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1286,"mutex_wait_us":1,"thread_start_us":1069,"threads_started":1}
I20260619 06:38:12.859805 12632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.851588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:52309 (local address 127.10.192.66:40471)
0619 06:38:12.851842 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:12.851848 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:12.852537 (+ 689us) server_negotiation.cc:407] Connection header received
0619 06:38:12.852788 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:12.852795 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:12.852859 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:12.852909 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:12.853693 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.854467 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.857040 (+ 2573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.858451 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.858638 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.858724 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:12.859330 (+ 606us) server_negotiation.cc:299] Negotiation successful
0619 06:38:12.859470 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260619 06:38:12.860934 12500 leader_election.cc:302] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 778825b73dcb4c8abfa702b9de030d62, f782309225c64440b10cf128df40e5cd; no voters:
I20260619 06:38:12.861398 12644 raft_consensus.cc:2781] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:38:12.861537 12644 raft_consensus.cc:482] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:38:12.861661 12644 raft_consensus.cc:3037] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:12.861642 12433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fa820040968408ab7916b986381eec3" candidate_uuid: "f782309225c64440b10cf128df40e5cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f6d326948844095ad4f44d712d3f386" is_pre_election: true
I20260619 06:38:12.861902 12433 raft_consensus.cc:2454] T 3fa820040968408ab7916b986381eec3 P 3f6d326948844095ad4f44d712d3f386 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f782309225c64440b10cf128df40e5cd in term 0.
I20260619 06:38:12.864037 12644 raft_consensus.cc:504] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.864689 12644 leader_election.cc:288] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd [CANDIDATE]: Term 1 election: Requested vote from peers 778825b73dcb4c8abfa702b9de030d62 (127.10.192.65:35117), 3f6d326948844095ad4f44d712d3f386 (127.10.192.66:40471)
I20260619 06:38:12.865242 12433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fa820040968408ab7916b986381eec3" candidate_uuid: "f782309225c64440b10cf128df40e5cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f6d326948844095ad4f44d712d3f386"
I20260619 06:38:12.865234 12289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fa820040968408ab7916b986381eec3" candidate_uuid: "f782309225c64440b10cf128df40e5cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "778825b73dcb4c8abfa702b9de030d62"
I20260619 06:38:12.865458 12289 raft_consensus.cc:3037] T 3fa820040968408ab7916b986381eec3 P 778825b73dcb4c8abfa702b9de030d62 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:12.865473 12433 raft_consensus.cc:3037] T 3fa820040968408ab7916b986381eec3 P 3f6d326948844095ad4f44d712d3f386 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:12.868547 12289 raft_consensus.cc:2454] T 3fa820040968408ab7916b986381eec3 P 778825b73dcb4c8abfa702b9de030d62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f782309225c64440b10cf128df40e5cd in term 1.
I20260619 06:38:12.869124 12500 leader_election.cc:302] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 778825b73dcb4c8abfa702b9de030d62, f782309225c64440b10cf128df40e5cd; no voters:
I20260619 06:38:12.868628 12433 raft_consensus.cc:2454] T 3fa820040968408ab7916b986381eec3 P 3f6d326948844095ad4f44d712d3f386 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f782309225c64440b10cf128df40e5cd in term 1.
I20260619 06:38:12.869463 12644 raft_consensus.cc:2781] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:12.869978 12644 raft_consensus.cc:686] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd [term 1 LEADER]: Becoming Leader. State: Replica: f782309225c64440b10cf128df40e5cd, State: Running, Role: LEADER
I20260619 06:38:12.870483 12644 consensus_queue.cc:237] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } }
I20260619 06:38:12.873242 12683 tablet_replica.cc:439] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd: TxnStatusTablet state changed. Reason: New leader f782309225c64440b10cf128df40e5cd. Latest consensus state: current_term: 1 leader_uuid: "f782309225c64440b10cf128df40e5cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } } }
I20260619 06:38:12.873770 12683 tablet_replica.cc:442] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd: This TxnStatusTablet replica's current role is: LEADER
I20260619 06:38:12.874776 12130 catalog_manager.cc:5495] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd reported cstate change: term changed from 0 to 1, leader changed from <none> to f782309225c64440b10cf128df40e5cd (127.10.192.67). New cstate: current_term: 1 leader_uuid: "f782309225c64440b10cf128df40e5cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260619 06:38:12.878007 12685 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260619 06:38:12.878289 12685 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260619 06:38:12.914135 12635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.906211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54192 (local address 127.10.192.67:37949)
0619 06:38:12.906977 (+ 766us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:12.906983 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:12.907002 (+ 19us) server_negotiation.cc:407] Connection header received
0619 06:38:12.907101 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:12.907107 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:12.907204 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:12.907361 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:38:12.907990 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.909132 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.911137 (+ 2005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.911894 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.912023 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.912609 (+ 586us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:38:12.913412 (+ 803us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:38:12.913556 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:12.913696 (+ 140us) server_negotiation.cc:299] Negotiation successful
0619 06:38:12.913783 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":631}
I20260619 06:38:12.914160 12675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.906124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:37949 (local address 127.0.0.1:54192)
0619 06:38:12.906515 (+ 391us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:12.906537 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:12.906683 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:12.907572 (+ 889us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:12.907578 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:12.907592 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 06:38:12.907827 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.907839 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.909299 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.909307 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.910981 (+ 1674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.910999 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.912063 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.912079 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.912311 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.912399 (+ 88us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 06:38:12.913541 (+ 1142us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 06:38:12.913565 (+ 24us) client_negotiation.cc:769] Sending connection context
0619 06:38:12.913663 (+ 98us) client_negotiation.cc:240] Negotiation successful
0619 06:38:12.913829 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205}
I20260619 06:38:12.919575 12289 raft_consensus.cc:1261] T 3fa820040968408ab7916b986381eec3 P 778825b73dcb4c8abfa702b9de030d62 [term 1 FOLLOWER]: Refusing update from remote peer f782309225c64440b10cf128df40e5cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:12.919697 12433 raft_consensus.cc:1261] T 3fa820040968408ab7916b986381eec3 P 3f6d326948844095ad4f44d712d3f386 [term 1 FOLLOWER]: Refusing update from remote peer f782309225c64440b10cf128df40e5cd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:12.920460 12644 consensus_queue.cc:1035] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:12.921259 12683 consensus_queue.cc:1035] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:12.934994 12647 tablet_replica.cc:439] T 3fa820040968408ab7916b986381eec3 P 3f6d326948844095ad4f44d712d3f386: TxnStatusTablet state changed. Reason: New leader f782309225c64440b10cf128df40e5cd. Latest consensus state: current_term: 1 leader_uuid: "f782309225c64440b10cf128df40e5cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } } }
I20260619 06:38:12.935352 12647 tablet_replica.cc:442] T 3fa820040968408ab7916b986381eec3 P 3f6d326948844095ad4f44d712d3f386: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:38:12.938719 12642 tablet_replica.cc:439] T 3fa820040968408ab7916b986381eec3 P 778825b73dcb4c8abfa702b9de030d62: TxnStatusTablet state changed. Reason: New leader f782309225c64440b10cf128df40e5cd. Latest consensus state: current_term: 1 leader_uuid: "f782309225c64440b10cf128df40e5cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } } }
I20260619 06:38:12.939069 12642 tablet_replica.cc:442] T 3fa820040968408ab7916b986381eec3 P 778825b73dcb4c8abfa702b9de030d62: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:38:12.950837 12642 tablet_replica.cc:439] T 3fa820040968408ab7916b986381eec3 P 778825b73dcb4c8abfa702b9de030d62: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f782309225c64440b10cf128df40e5cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } } }
I20260619 06:38:12.950889 12683 tablet_replica.cc:439] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f782309225c64440b10cf128df40e5cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } } }
I20260619 06:38:12.951211 12642 tablet_replica.cc:442] T 3fa820040968408ab7916b986381eec3 P 778825b73dcb4c8abfa702b9de030d62: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:38:12.951242 12683 tablet_replica.cc:442] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd: This TxnStatusTablet replica's current role is: LEADER
I20260619 06:38:12.952873 12683 tablet_replica.cc:439] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f782309225c64440b10cf128df40e5cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } } }
I20260619 06:38:12.953233 12683 tablet_replica.cc:442] T 3fa820040968408ab7916b986381eec3 P f782309225c64440b10cf128df40e5cd: This TxnStatusTablet replica's current role is: LEADER
I20260619 06:38:12.955570 12647 tablet_replica.cc:439] T 3fa820040968408ab7916b986381eec3 P 3f6d326948844095ad4f44d712d3f386: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f782309225c64440b10cf128df40e5cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "778825b73dcb4c8abfa702b9de030d62" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35117 } } peers { permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 } } peers { permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 } } }
I20260619 06:38:12.955915 12647 tablet_replica.cc:442] T 3fa820040968408ab7916b986381eec3 P 3f6d326948844095ad4f44d712d3f386: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:38:12.971132 12682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.964778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46606 (local address 127.10.192.65:35117)
0619 06:38:12.965031 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:12.965038 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:12.965388 (+ 350us) server_negotiation.cc:407] Connection header received
0619 06:38:12.965650 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:12.965654 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:12.965743 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:12.965931 (+ 188us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:38:12.966387 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.967192 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.968721 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.969151 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.969289 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.969745 (+ 456us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:38:12.970467 (+ 722us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:38:12.970642 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:12.970694 (+ 52us) server_negotiation.cc:299] Negotiation successful
0619 06:38:12.970805 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260619 06:38:12.989598 12635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.983151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:37139 (local address 127.10.192.67:37949)
0619 06:38:12.983365 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:12.983372 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:12.983669 (+ 297us) server_negotiation.cc:407] Connection header received
0619 06:38:12.983938 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:12.983944 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:12.984034 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:12.984150 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:38:12.984631 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.985833 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.987300 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.988140 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.988271 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.988789 (+ 518us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:38:12.988934 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:38:12.989027 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:12.989192 (+ 165us) server_negotiation.cc:299] Negotiation successful
0619 06:38:12.989273 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260619 06:38:12.989677 12701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:12.982814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:37949 (local address 127.10.192.65:37139)
0619 06:38:12.983447 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:12.983466 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:12.983759 (+ 293us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:12.984200 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:12.984204 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:12.984215 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 06:38:12.984474 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.984482 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.985981 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.985985 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.987165 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:12.987178 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:12.988391 (+ 1213us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:12.988415 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:12.988543 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:12.988605 (+ 62us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 06:38:12.989058 (+ 453us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 06:38:12.989069 (+ 11us) client_negotiation.cc:769] Sending connection context
0619 06:38:12.989146 (+ 77us) client_negotiation.cc:240] Negotiation successful
0619 06:38:12.989263 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"spinlock_wait_cycles":10496,"thread_start_us":414,"threads_started":1}
I20260619 06:38:12.999923 12566 raft_consensus.cc:1261] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd [term 1 FOLLOWER]: Refusing update from remote peer 778825b73dcb4c8abfa702b9de030d62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:12.999927 12433 raft_consensus.cc:1261] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386 [term 1 FOLLOWER]: Refusing update from remote peer 778825b73dcb4c8abfa702b9de030d62: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:13.000633 12668 consensus_queue.cc:1035] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f782309225c64440b10cf128df40e5cd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:13.001111 12642 consensus_queue.cc:1035] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f6d326948844095ad4f44d712d3f386" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40471 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:13.053833 12682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:13.036419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:60649 (local address 127.10.192.65:35117)
0619 06:38:13.036659 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:13.036669 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:13.046418 (+ 9749us) server_negotiation.cc:407] Connection header received
0619 06:38:13.046868 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:13.046876 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:13.046987 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:13.047052 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:38:13.047868 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:13.049079 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:13.051408 (+ 2329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:13.052159 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:13.052278 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:13.052984 (+ 706us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:38:13.053122 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:38:13.053188 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:13.053418 (+ 230us) server_negotiation.cc:299] Negotiation successful
0619 06:38:13.053507 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260619 06:38:13.053911 12707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:13.035975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:35117 (local address 127.10.192.67:60649)
0619 06:38:13.046291 (+ 10316us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:13.046314 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:13.046694 (+ 380us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:13.047242 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:13.047247 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:13.047260 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 06:38:13.047682 (+ 422us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:13.047695 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:13.049266 (+ 1571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:13.049272 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:13.051216 (+ 1944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:13.051233 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:13.052522 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:13.052529 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:13.052695 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:13.052771 (+ 76us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 06:38:13.053264 (+ 493us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 06:38:13.053275 (+ 11us) client_negotiation.cc:769] Sending connection context
0619 06:38:13.053355 (+ 80us) client_negotiation.cc:240] Negotiation successful
0619 06:38:13.053525 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10067,"thread_start_us":10453,"threads_started":1}
I20260619 06:38:13.114281 12131 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:38:13.114576 12131 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39046:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:38:13.118326 12131 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cdc7a374db824e8b99e4965a4a57cb24: Sending DeleteTablet for 3 replicas of tablet a415116bc74546269d36a08530d0cee7
I20260619 06:38:13.119892 12407 tablet_service.cc:1514] Processing DeleteTablet for tablet a415116bc74546269d36a08530d0cee7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:13 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:53046
I20260619 06:38:13.120688 12268 tablet_service.cc:1514] Processing DeleteTablet for tablet a415116bc74546269d36a08530d0cee7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:13 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:46598
I20260619 06:38:13.122587 12547 tablet_service.cc:1514] Processing DeleteTablet for tablet a415116bc74546269d36a08530d0cee7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:13 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:54188
I20260619 06:38:13.163097 12712 tablet_replica.cc:330] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd: stopping tablet replica
I20260619 06:38:13.163439 12712 raft_consensus.cc:2229] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:13.164060 12711 tablet_replica.cc:330] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62: stopping tablet replica
I20260619 06:38:13.164534 12710 tablet_replica.cc:330] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386: stopping tablet replica
I20260619 06:38:13.164901 12712 raft_consensus.cc:2258] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:13.165187 12710 raft_consensus.cc:2229] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:13.165616 12711 raft_consensus.cc:2229] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:38:13.166843 12712 ts_tablet_manager.cc:1905] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:13.167197 12710 raft_consensus.cc:2258] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:13.167883 12711 raft_consensus.cc:2258] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:13.173653 12710 ts_tablet_manager.cc:1905] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:13.174949 12711 ts_tablet_manager.cc:1905] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62: Deleting tablet data with delete state TABLET_DATA_DELETED
Jun 19 06:38:13 dist-test-slave-7lz4 krb5kdc[12087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851092, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:38:13.182505 12710 ts_tablet_manager.cc:1918] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 06:38:13.182819 12710 log.cc:1196] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/a415116bc74546269d36a08530d0cee7
I20260619 06:38:13.183450 12710 ts_tablet_manager.cc:1939] T a415116bc74546269d36a08530d0cee7 P 3f6d326948844095ad4f44d712d3f386: Deleting consensus metadata
I20260619 06:38:13.184895 12116 catalog_manager.cc:4841] TS 3f6d326948844095ad4f44d712d3f386 (127.10.192.66:40471): tablet a415116bc74546269d36a08530d0cee7 (table test-table [id=350f9fd226854af1b209baeef46ee2b0]) successfully deleted
I20260619 06:38:13.185061 12712 ts_tablet_manager.cc:1918] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 06:38:13.185189 12712 log.cc:1196] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/a415116bc74546269d36a08530d0cee7
I20260619 06:38:13.185634 12712 ts_tablet_manager.cc:1939] T a415116bc74546269d36a08530d0cee7 P f782309225c64440b10cf128df40e5cd: Deleting consensus metadata
I20260619 06:38:13.189088 12711 ts_tablet_manager.cc:1918] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 06:38:13.189227 12711 log.cc:1196] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/a415116bc74546269d36a08530d0cee7
I20260619 06:38:13.189700 12711 ts_tablet_manager.cc:1939] T a415116bc74546269d36a08530d0cee7 P 778825b73dcb4c8abfa702b9de030d62: Deleting consensus metadata
I20260619 06:38:13.190872 12682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:13.164492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46612 (local address 127.10.192.65:35117)
0619 06:38:13.164685 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:13.164692 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:13.168660 (+ 3968us) server_negotiation.cc:407] Connection header received
0619 06:38:13.169186 (+ 526us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:13.169193 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:13.169301 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:13.169375 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:13.171659 (+ 2284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:13.172878 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:13.174888 (+ 2010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:13.175553 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:13.175683 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:13.181098 (+ 5415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:13.181117 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:13.181135 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:13.181178 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:13.185307 (+ 4129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:13.187373 (+ 2066us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:13.187383 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:13.187388 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:13.187661 (+ 273us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:13.188231 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:13.188239 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:13.188244 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:13.188737 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:13.189060 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:13.190283 (+ 1223us) server_negotiation.cc:299] Negotiation successful
0619 06:38:13.190518 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 06:38:13.190922 12118 catalog_manager.cc:4841] TS 778825b73dcb4c8abfa702b9de030d62 (127.10.192.65:35117): tablet a415116bc74546269d36a08530d0cee7 (table test-table [id=350f9fd226854af1b209baeef46ee2b0]) successfully deleted
W20260619 06:38:13.191498 12334 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46612
I20260619 06:38:13.192370 12116 catalog_manager.cc:4841] TS f782309225c64440b10cf128df40e5cd (127.10.192.67:37949): tablet a415116bc74546269d36a08530d0cee7 (table test-table [id=350f9fd226854af1b209baeef46ee2b0]) successfully deleted
I20260619 06:38:13.212121 12676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:13.195192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39068 (local address 127.10.192.126:40657)
0619 06:38:13.195449 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:13.195455 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:13.195760 (+ 305us) server_negotiation.cc:407] Connection header received
0619 06:38:13.195953 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:13.195960 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:13.196044 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:13.196149 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:13.197953 (+ 1804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:13.199118 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:13.201098 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:13.201830 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:13.201976 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:13.205217 (+ 3241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:13.205224 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:13.205229 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:13.205279 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:13.209065 (+ 3786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:13.209924 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:13.209929 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:13.209933 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:13.210088 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:13.210492 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:13.210498 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:13.210502 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:13.210865 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:13.211134 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:13.211476 (+ 342us) server_negotiation.cc:299] Negotiation successful
0619 06:38:13.211768 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260619 06:38:13.212782 12131 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39068
I20260619 06:38:13.215492 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 12203
I20260619 06:38:13.239372 12682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:13.216550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46618 (local address 127.10.192.65:35117)
0619 06:38:13.216738 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:13.216744 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:13.222399 (+ 5655us) server_negotiation.cc:407] Connection header received
0619 06:38:13.222686 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:13.222694 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:13.222814 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:13.222935 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:13.224623 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:13.225912 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:13.227781 (+ 1869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:13.228545 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:13.228675 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:13.231948 (+ 3273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:13.231956 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:13.231962 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:13.232018 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:13.235853 (+ 3835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:13.236908 (+ 1055us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:13.236914 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:13.236918 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:13.237101 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:13.237653 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:13.237659 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:13.237662 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:13.238073 (+ 411us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:13.238385 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:13.238698 (+ 313us) server_negotiation.cc:299] Negotiation successful
0619 06:38:13.238944 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260619 06:38:13.239970 12334 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46618
W20260619 06:38:13.240615 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 12203: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:38:13.240814 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 12203
I20260619 06:38:13.255812 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 12343
Jun 19 06:38:13 dist-test-slave-7lz4 krb5kdc[12087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851092, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.192.66@KRBTEST.COM
I20260619 06:38:13.273576 12632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:13.256597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53058 (local address 127.10.192.66:40471)
0619 06:38:13.256797 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:13.256803 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:13.256825 (+ 22us) server_negotiation.cc:407] Connection header received
0619 06:38:13.256971 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:13.256977 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:13.257062 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:13.257189 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:13.258352 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:13.259439 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:13.260766 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:13.261448 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:13.261593 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:13.266016 (+ 4423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:13.266036 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:13.266058 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:13.266116 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:13.270341 (+ 4225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:13.271180 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:13.271192 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:13.271195 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:13.271381 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:13.271831 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:13.271837 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:13.271840 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:13.272364 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:13.272722 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:13.272900 (+ 178us) server_negotiation.cc:299] Negotiation successful
0619 06:38:13.273162 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
W20260619 06:38:13.274420 12473 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53058
W20260619 06:38:13.275177 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 12343: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:38:13.275368 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 12343
I20260619 06:38:13.304030 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 12482
Jun 19 06:38:13 dist-test-slave-7lz4 krb5kdc[12087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851092, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.192.67@KRBTEST.COM
I20260619 06:38:13.322284 12635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:13.304878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54200 (local address 127.10.192.67:37949)
0619 06:38:13.305090 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:13.305096 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:13.305121 (+ 25us) server_negotiation.cc:407] Connection header received
0619 06:38:13.305269 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:13.305275 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:13.305360 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:13.305496 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:13.306798 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:13.307992 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:13.309284 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:13.309965 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:13.310119 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:13.314474 (+ 4355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:13.314491 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:13.314513 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:13.314562 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:13.318737 (+ 4175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:13.319552 (+ 815us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:13.319562 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:13.319566 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:13.320088 (+ 522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:13.320501 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:13.320510 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:13.320515 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:13.321024 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:13.321360 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:13.321625 (+ 265us) server_negotiation.cc:299] Negotiation successful
0619 06:38:13.321857 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
W20260619 06:38:13.323154 12612 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54200
W20260619 06:38:13.323938 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 12482: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:38:13.324132 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 12482
I20260619 06:38:13.344090 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 12100
I20260619 06:38:13.345269 12172 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:13.460793 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 12100
2026-06-19T06:38:13Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (4732 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:38:13 dist-test-slave-7lz4 krb5kdc[12721](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:38:13 dist-test-slave-7lz4 krb5kdc[12721](info): set up 2 sockets
Jun 19 06:38:13 dist-test-slave-7lz4 krb5kdc[12721](info): commencing operation
krb5kdc: starting...
W20260619 06:38:14.543962 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.005s sys 0.013s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:38:14 dist-test-slave-7lz4 krb5kdc[12721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851094, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:38:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:38:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:38:14.739499 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:45165
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:33893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:45165
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:15.070396 12734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:15.070791 12734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:15.070966 12734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:15.078438 12734 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:38:15.078615 12734 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260619 06:38:15.078711 12734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:15.078832 12734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:15.078917 12734 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:38:15.079007 12734 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:38:15.089176 12734 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:33893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:45165
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:45165
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:15.090621 12734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:15.092121 12734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:15.104467 12740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:15.104539 12739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:15.104488 12742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:15.105403 12734 server_base.cc:1034] running on GCE node
I20260619 06:38:15.106316 12734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:15.107832 12734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:15.109052 12734 hybrid_clock.cc:648] HybridClock initialized: now 1781851095108991 us; error 33 us; skew 500 ppm
I20260619 06:38:15.109402 12734 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:15 dist-test-slave-7lz4 krb5kdc[12721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851095, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:15.112605 12734 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:38:15.114043 12734 webserver.cc:460] Webserver started at http://127.10.192.126:39451/ using document root <none> and password file <none>
I20260619 06:38:15.114773 12734 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:15.114885 12734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:15.115233 12734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:15.118484 12734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "9c1d8a55754d4f7eae925c0f691d3de5"
format_stamp: "Formatted at 2026-06-19 06:38:15 on dist-test-slave-7lz4"
server_key: "df7c16f026c78f89fe70c80e36f35410"
server_key_iv: "026e567af100d44a4d0811b258be9c5f"
server_key_version: "encryptionkey@0"
I20260619 06:38:15.119307 12734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "9c1d8a55754d4f7eae925c0f691d3de5"
format_stamp: "Formatted at 2026-06-19 06:38:15 on dist-test-slave-7lz4"
server_key: "df7c16f026c78f89fe70c80e36f35410"
server_key_iv: "026e567af100d44a4d0811b258be9c5f"
server_key_version: "encryptionkey@0"
I20260619 06:38:15.124979 12734 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260619 06:38:15.128649 12749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:15.130097 12734 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:38:15.130285 12734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "9c1d8a55754d4f7eae925c0f691d3de5"
format_stamp: "Formatted at 2026-06-19 06:38:15 on dist-test-slave-7lz4"
server_key: "df7c16f026c78f89fe70c80e36f35410"
server_key_iv: "026e567af100d44a4d0811b258be9c5f"
server_key_version: "encryptionkey@0"
I20260619 06:38:15.130548 12734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:15.146471 12734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:15.150754 12734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:15.151049 12734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:15.173185 12734 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:45165
I20260619 06:38:15.173210 12810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:45165 every 8 connection(s)
I20260619 06:38:15.174695 12734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:38:15.178493 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 12734
I20260619 06:38:15.178707 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:38:15.178900 12811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:15.179507 11009 external_mini_cluster.cc:1428] Setting key f5563cda0ceda5a3d45ae2241cd97e3a
I20260619 06:38:15.192190 12811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5: Bootstrap starting.
Jun 19 06:38:15 dist-test-slave-7lz4 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851094, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:15.195784 12811 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:15.196874 12811 log.cc:824] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:15.199852 12811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5: No bootstrap required, opened a new log
I20260619 06:38:15.201669 12814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:15.181637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47252 (local address 127.10.192.126:45165)
0619 06:38:15.182448 (+ 811us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:15.182460 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:15.182520 (+ 60us) server_negotiation.cc:407] Connection header received
0619 06:38:15.184190 (+ 1670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:15.184213 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:15.184654 (+ 441us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:15.185100 (+ 446us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:15.186589 (+ 1489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:15.187941 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:15.189188 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:15.189945 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:15.190166 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:15.194393 (+ 4227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:15.194401 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:15.194415 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:15.194458 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:15.197614 (+ 3156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:15.198331 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:15.198337 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:15.198344 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:15.198501 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:15.198871 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:15.198876 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:15.198879 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:15.199403 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:15.199728 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:15.200188 (+ 460us) server_negotiation.cc:299] Negotiation successful
0619 06:38:15.200616 (+ 428us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":607,"thread_start_us":390,"threads_started":1}
I20260619 06:38:15.207950 12811 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c1d8a55754d4f7eae925c0f691d3de5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 45165 } }
I20260619 06:38:15.208388 12811 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:15.208505 12811 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c1d8a55754d4f7eae925c0f691d3de5, State: Initialized, Role: FOLLOWER
I20260619 06:38:15.209164 12811 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c1d8a55754d4f7eae925c0f691d3de5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 45165 } }
I20260619 06:38:15.209416 12811 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:38:15.209561 12811 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:38:15.209735 12811 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:15.212519 12811 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c1d8a55754d4f7eae925c0f691d3de5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 45165 } }
I20260619 06:38:15.213094 12811 leader_election.cc:302] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9c1d8a55754d4f7eae925c0f691d3de5; no voters:
I20260619 06:38:15.213685 12811 leader_election.cc:288] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:38:15.213832 12816 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:15.214527 12816 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5 [term 1 LEADER]: Becoming Leader. State: Replica: 9c1d8a55754d4f7eae925c0f691d3de5, State: Running, Role: LEADER
I20260619 06:38:15.215130 12816 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c1d8a55754d4f7eae925c0f691d3de5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 45165 } }
I20260619 06:38:15.216104 12811 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:38:15.218385 12818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9c1d8a55754d4f7eae925c0f691d3de5. Latest consensus state: current_term: 1 leader_uuid: "9c1d8a55754d4f7eae925c0f691d3de5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c1d8a55754d4f7eae925c0f691d3de5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 45165 } } }
I20260619 06:38:15.218395 12817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9c1d8a55754d4f7eae925c0f691d3de5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c1d8a55754d4f7eae925c0f691d3de5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 45165 } } }
I20260619 06:38:15.218849 12817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:15.218849 12818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:15.219759 12822 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:38:15.226853 12822 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:38:15.241899 12822 catalog_manager.cc:1347] Generated new cluster ID: 858a8efb121e49d89e3f6fc4595007ef
I20260619 06:38:15.242043 12822 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:38:15.262744 12822 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:38:15.264770 12822 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:38:15.275007 12822 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5: Generated new TSK 0
I20260619 06:38:15.276196 12822 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
I20260619 06:38:15.327618 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:45165
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:33893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:15.660574 12837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:15.660953 12837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:15.661149 12837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:15.668637 12837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:15.668810 12837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:15.668974 12837 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260619 06:38:15.669064 12837 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 06:38:15.669204 12837 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:38:15.679327 12837 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:33893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.192.126:45165
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:15.680836 12837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:15.682261 12837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:15.696497 12842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:15.696439 12843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:15.696439 12845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:15.697420 12837 server_base.cc:1034] running on GCE node
I20260619 06:38:15.698133 12837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:15.699149 12837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:15.700353 12837 hybrid_clock.cc:648] HybridClock initialized: now 1781851095700292 us; error 74 us; skew 500 ppm
I20260619 06:38:15.700738 12837 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:15 dist-test-slave-7lz4 krb5kdc[12721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851095, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:15.704181 12837 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:38:15.705691 12837 webserver.cc:460] Webserver started at http://127.10.192.65:43891/ using document root <none> and password file <none>
I20260619 06:38:15.706431 12837 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:15.706560 12837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:15.706889 12837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:15.709995 12837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "504427d18ad64c629a25b5e936dc80e1"
format_stamp: "Formatted at 2026-06-19 06:38:15 on dist-test-slave-7lz4"
server_key: "57846c31bb920e500f080c82f1e83570"
server_key_iv: "4ffa3db119360d3473e4cb7e75f707df"
server_key_version: "encryptionkey@0"
I20260619 06:38:15.710789 12837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "504427d18ad64c629a25b5e936dc80e1"
format_stamp: "Formatted at 2026-06-19 06:38:15 on dist-test-slave-7lz4"
server_key: "57846c31bb920e500f080c82f1e83570"
server_key_iv: "4ffa3db119360d3473e4cb7e75f707df"
server_key_version: "encryptionkey@0"
I20260619 06:38:15.716288 12837 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260619 06:38:15.719991 12852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:15.721352 12837 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:38:15.721513 12837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "504427d18ad64c629a25b5e936dc80e1"
format_stamp: "Formatted at 2026-06-19 06:38:15 on dist-test-slave-7lz4"
server_key: "57846c31bb920e500f080c82f1e83570"
server_key_iv: "4ffa3db119360d3473e4cb7e75f707df"
server_key_version: "encryptionkey@0"
I20260619 06:38:15.721686 12837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:15.740535 12837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:15.744851 12837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:15.745100 12837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:15.747898 12837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:15.747998 12837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:15.748140 12837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:15.748245 12837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 06:38:15 dist-test-slave-7lz4 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851095, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:15.775125 12861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:15.748803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:54201 (local address 127.10.192.126:45165)
0619 06:38:15.749260 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:15.749266 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:15.750654 (+ 1388us) server_negotiation.cc:407] Connection header received
0619 06:38:15.753126 (+ 2472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:15.753132 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:15.753233 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:15.753379 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:15.756282 (+ 2903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:15.757621 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:15.761219 (+ 3598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:15.761810 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:15.761971 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:15.767739 (+ 5768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:15.767744 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:15.767748 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:15.767786 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:15.770453 (+ 2667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:15.771742 (+ 1289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:15.771746 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:15.771748 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:15.771881 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:15.772545 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:15.772548 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:15.772551 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:15.772980 (+ 429us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:15.773152 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:15.774299 (+ 1147us) server_negotiation.cc:299] Negotiation successful
0619 06:38:15.774578 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334,"thread_start_us":225,"threads_started":1}
I20260619 06:38:15.777019 12862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:15.749542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:45165 (local address 127.10.192.65:54201)
0619 06:38:15.750450 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:15.750510 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:15.752772 (+ 2262us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:15.753724 (+ 952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:15.753743 (+ 19us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:15.754779 (+ 1036us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:15.755990 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:15.756024 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:15.757953 (+ 1929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:15.757962 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:15.760980 (+ 3018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:15.761013 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:15.762298 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:15.762308 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:15.762615 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:15.763580 (+ 965us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:15.763624 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:15.767363 (+ 3739us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:15.770637 (+ 3274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:15.770651 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:15.770678 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:15.771533 (+ 855us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:15.772025 (+ 492us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:15.772031 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:15.772035 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:15.772393 (+ 358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:15.773125 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:15.773134 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:15.773756 (+ 622us) client_negotiation.cc:769] Sending connection context
0619 06:38:15.774129 (+ 373us) client_negotiation.cc:240] Negotiation successful
0619 06:38:15.774862 (+ 733us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":403,"threads_started":1}
I20260619 06:38:15.798476 12861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:15.783711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:50213 (local address 127.10.192.126:45165)
0619 06:38:15.783882 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:15.783887 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:15.784520 (+ 633us) server_negotiation.cc:407] Connection header received
0619 06:38:15.784753 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:15.784757 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:15.784844 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:15.784950 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:15.786505 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:15.787415 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:15.789202 (+ 1787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:15.789777 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:15.789925 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:15.792383 (+ 2458us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:15.792397 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:15.792401 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:15.792434 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:15.795424 (+ 2990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:15.796354 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:15.796359 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:15.796361 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:15.796512 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:15.796929 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:15.796939 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:15.796941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:15.797225 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:15.797440 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:15.797829 (+ 389us) server_negotiation.cc:299] Negotiation successful
0619 06:38:15.798095 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260619 06:38:15.798899 12940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:15.783787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:45165 (local address 127.10.192.65:50213)
0619 06:38:15.784407 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:15.784423 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:15.784595 (+ 172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:15.785160 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:15.785166 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:15.785842 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:15.786284 (+ 442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:15.786304 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:15.787575 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:15.787578 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:15.789048 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:15.789063 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:15.789962 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:15.789968 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:15.790158 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:15.790888 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:15.790919 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:15.792113 (+ 1194us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:15.795569 (+ 3456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:15.795575 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:15.795579 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:15.796077 (+ 498us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:15.796637 (+ 560us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:15.796643 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:15.796647 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:15.796790 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:15.797351 (+ 561us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:15.797357 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:15.797567 (+ 210us) client_negotiation.cc:769] Sending connection context
0619 06:38:15.797711 (+ 144us) client_negotiation.cc:240] Negotiation successful
0619 06:38:15.798102 (+ 391us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":356,"threads_started":1}
I20260619 06:38:15.801132 12837 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:42813
I20260619 06:38:15.801153 12972 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:42813 every 8 connection(s)
I20260619 06:38:15.802469 12837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:38:15.804812 12973 heartbeater.cc:347] Connected to a master server at 127.10.192.126:45165
I20260619 06:38:15.805030 12973 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:15.805677 12973 heartbeater.cc:511] Master 127.10.192.126:45165 requested a full tablet report, sending...
I20260619 06:38:15.807602 12766 ts_manager.cc:194] Registered new tserver with Master: 504427d18ad64c629a25b5e936dc80e1 (127.10.192.65:42813)
I20260619 06:38:15.809064 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 12837
I20260619 06:38:15.809082 12766 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:54201
I20260619 06:38:15.809278 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:38:15.809929 11009 external_mini_cluster.cc:1428] Setting key 7dae461b91b8247a252226a8dbc21f5a
WARNING: no policy specified for kudu/127.10.192.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
I20260619 06:38:15.852746 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:45165
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:33893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:16.183862 12977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:16.184213 12977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:16.184412 12977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:16.192091 12977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:16.192250 12977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:16.192415 12977 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260619 06:38:16.192510 12977 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 06:38:16.192651 12977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:38:16.203024 12977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:33893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.192.126:45165
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:16.204491 12977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:16.206014 12977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:16.219545 12983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:16.219803 12985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:16.219563 12982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:16.221643 12977 server_base.cc:1034] running on GCE node
I20260619 06:38:16.222371 12977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:16.223387 12977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:16.224620 12977 hybrid_clock.cc:648] HybridClock initialized: now 1781851096224568 us; error 54 us; skew 500 ppm
I20260619 06:38:16.224980 12977 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:16 dist-test-slave-7lz4 krb5kdc[12721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851096, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:16.228502 12977 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:38:16.230057 12977 webserver.cc:460] Webserver started at http://127.10.192.66:46831/ using document root <none> and password file <none>
I20260619 06:38:16.230794 12977 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:16.230939 12977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:16.231268 12977 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:16.234526 12977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "966ce41aae8a49d0933280cc4633f6dd"
format_stamp: "Formatted at 2026-06-19 06:38:16 on dist-test-slave-7lz4"
server_key: "e5fb38dc7d35a9228a72dc3c4615a672"
server_key_iv: "5d92f495f33a89c65553fc633f323c4b"
server_key_version: "encryptionkey@0"
I20260619 06:38:16.235479 12977 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "966ce41aae8a49d0933280cc4633f6dd"
format_stamp: "Formatted at 2026-06-19 06:38:16 on dist-test-slave-7lz4"
server_key: "e5fb38dc7d35a9228a72dc3c4615a672"
server_key_iv: "5d92f495f33a89c65553fc633f323c4b"
server_key_version: "encryptionkey@0"
I20260619 06:38:16.240940 12977 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260619 06:38:16.244632 12992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:16.246044 12977 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:38:16.246232 12977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "966ce41aae8a49d0933280cc4633f6dd"
format_stamp: "Formatted at 2026-06-19 06:38:16 on dist-test-slave-7lz4"
server_key: "e5fb38dc7d35a9228a72dc3c4615a672"
server_key_iv: "5d92f495f33a89c65553fc633f323c4b"
server_key_version: "encryptionkey@0"
I20260619 06:38:16.246439 12977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:16.272774 12977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:16.277889 12977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:16.278241 12977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:16.281517 12977 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:16.281651 12977 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:16.281785 12977 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:16.281889 12977 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 06:38:16 dist-test-slave-7lz4 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851096, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:16.307205 12861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:16.282039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:59039 (local address 127.10.192.126:45165)
0619 06:38:16.282240 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:16.282250 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:16.284042 (+ 1792us) server_negotiation.cc:407] Connection header received
0619 06:38:16.286148 (+ 2106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:16.286154 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:16.286255 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:16.286371 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:16.289012 (+ 2641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.289938 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.292848 (+ 2910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.293506 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.293653 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:16.298540 (+ 4887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:16.298552 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:16.298560 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:16.298624 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:16.302785 (+ 4161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:16.304213 (+ 1428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:16.304221 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:16.304227 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:16.304413 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:16.305180 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:16.305189 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:16.305194 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:16.305591 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:16.305774 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:16.306597 (+ 823us) server_negotiation.cc:299] Negotiation successful
0619 06:38:16.306846 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260619 06:38:16.308411 13001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:16.282921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:45165 (local address 127.10.192.66:59039)
0619 06:38:16.283847 (+ 926us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:16.283894 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:16.285836 (+ 1942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:16.286754 (+ 918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:16.286771 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:16.287720 (+ 949us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:16.288776 (+ 1056us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:16.288809 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.290118 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.290129 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:16.292621 (+ 2492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:16.292640 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.293797 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.293805 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:16.294150 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:16.295106 (+ 956us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:16.295150 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:16.298169 (+ 3019us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:16.302958 (+ 4789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:16.302972 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:16.303003 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:16.304007 (+ 1004us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:16.304600 (+ 593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:16.304612 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:16.304619 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:16.305006 (+ 387us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:16.305738 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:16.305748 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:16.306183 (+ 435us) client_negotiation.cc:769] Sending connection context
0619 06:38:16.306488 (+ 305us) client_negotiation.cc:240] Negotiation successful
0619 06:38:16.307076 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":398,"threads_started":1}
I20260619 06:38:16.333369 13059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:16.314843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:45165 (local address 127.10.192.66:41633)
0619 06:38:16.315894 (+ 1051us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:16.315923 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:16.316107 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:16.316772 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:16.316779 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:16.317733 (+ 954us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:16.318314 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:16.318332 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.319749 (+ 1417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.319755 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:16.322179 (+ 2424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:16.322207 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.323367 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.323378 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:16.323609 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:16.324471 (+ 862us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:16.324491 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:16.325420 (+ 929us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:16.329793 (+ 4373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:16.329801 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:16.329808 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:16.330462 (+ 654us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:16.330993 (+ 531us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:16.331001 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:16.331005 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:16.331209 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:16.332121 (+ 912us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:16.332124 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:16.332379 (+ 255us) client_negotiation.cc:769] Sending connection context
0619 06:38:16.332578 (+ 199us) client_negotiation.cc:240] Negotiation successful
0619 06:38:16.332984 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":864,"thread_start_us":684,"threads_started":1}
I20260619 06:38:16.333536 12861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:16.314858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:41633 (local address 127.10.192.126:45165)
0619 06:38:16.315098 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:16.315107 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:16.316037 (+ 930us) server_negotiation.cc:407] Connection header received
0619 06:38:16.316310 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:16.316318 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:16.316403 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:16.316480 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:16.318527 (+ 2047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.319526 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.322377 (+ 2851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.322898 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.323042 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:16.325627 (+ 2585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:16.325632 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:16.325635 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:16.325669 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:16.329620 (+ 3951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:16.330624 (+ 1004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:16.330633 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:16.330640 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:16.330835 (+ 195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:16.331385 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:16.331391 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:16.331395 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:16.331904 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:16.332054 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:16.332728 (+ 674us) server_negotiation.cc:299] Negotiation successful
0619 06:38:16.333029 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260619 06:38:16.336720 12977 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:42805
I20260619 06:38:16.336792 13111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:42805 every 8 connection(s)
I20260619 06:38:16.338297 12977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:38:16.340265 13112 heartbeater.cc:347] Connected to a master server at 127.10.192.126:45165
I20260619 06:38:16.340492 13112 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:16.341131 13112 heartbeater.cc:511] Master 127.10.192.126:45165 requested a full tablet report, sending...
I20260619 06:38:16.342521 12766 ts_manager.cc:194] Registered new tserver with Master: 966ce41aae8a49d0933280cc4633f6dd (127.10.192.66:42805)
I20260619 06:38:16.342792 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 12977
I20260619 06:38:16.342963 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:38:16.343398 11009 external_mini_cluster.cc:1428] Setting key cfd112f6571f8308a058f6166c3f8c58
I20260619 06:38:16.343423 12766 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:59039
WARNING: no policy specified for kudu/127.10.192.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
I20260619 06:38:16.383159 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:45165
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:33893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:16.729717 13116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:16.730070 13116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:16.730283 13116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:16.738036 13116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:16.738205 13116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:16.738368 13116 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260619 06:38:16.738462 13116 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 06:38:16.738601 13116 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:38:16.750237 13116 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:33893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.192.126:45165
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:16.751861 13116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:16.753216 13116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:16.766810 13124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:16.766770 13121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:16.766909 13122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:16.767514 13116 server_base.cc:1034] running on GCE node
I20260619 06:38:16.768177 13116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:16.769096 13116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:16.770371 13116 hybrid_clock.cc:648] HybridClock initialized: now 1781851096770300 us; error 63 us; skew 500 ppm
I20260619 06:38:16.770766 13116 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:16 dist-test-slave-7lz4 krb5kdc[12721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851096, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:16.779953 13116 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:38:16.781653 13116 webserver.cc:460] Webserver started at http://127.10.192.67:42837/ using document root <none> and password file <none>
I20260619 06:38:16.782413 13116 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:16.782572 13116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:16.783010 13116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:16.787190 13116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "638cc9bb76fa4f3f81669bf8f58996ac"
format_stamp: "Formatted at 2026-06-19 06:38:16 on dist-test-slave-7lz4"
server_key: "bdcca26d01f7cb8626c0daff89973611"
server_key_iv: "1178df454bf513160e08433d8cf3c71f"
server_key_version: "encryptionkey@0"
I20260619 06:38:16.788204 13116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "638cc9bb76fa4f3f81669bf8f58996ac"
format_stamp: "Formatted at 2026-06-19 06:38:16 on dist-test-slave-7lz4"
server_key: "bdcca26d01f7cb8626c0daff89973611"
server_key_iv: "1178df454bf513160e08433d8cf3c71f"
server_key_version: "encryptionkey@0"
I20260619 06:38:16.793668 13116 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 06:38:16.797446 13131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:16.799014 13116 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 06:38:16.799309 13116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "638cc9bb76fa4f3f81669bf8f58996ac"
format_stamp: "Formatted at 2026-06-19 06:38:16 on dist-test-slave-7lz4"
server_key: "bdcca26d01f7cb8626c0daff89973611"
server_key_iv: "1178df454bf513160e08433d8cf3c71f"
server_key_version: "encryptionkey@0"
I20260619 06:38:16.799561 13116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:16.812247 12973 heartbeater.cc:503] Master 127.10.192.126:45165 was elected leader, sending a full tablet report...
I20260619 06:38:16.817831 13116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:16.822549 13116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:16.822865 13116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:16.825963 13116 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:16.826100 13116 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:16.826239 13116 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:16.826340 13116 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 06:38:16 dist-test-slave-7lz4 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851096, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:16.853916 12861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:16.826591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:53275 (local address 127.10.192.126:45165)
0619 06:38:16.826778 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:16.826784 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:16.828432 (+ 1648us) server_negotiation.cc:407] Connection header received
0619 06:38:16.831696 (+ 3264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:16.831704 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:16.831816 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:16.831929 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:16.835143 (+ 3214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.836337 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.839032 (+ 2695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.839548 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.839723 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:16.845412 (+ 5689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:16.845423 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:16.845431 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:16.845493 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:16.849479 (+ 3986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:16.850956 (+ 1477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:16.850964 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:16.850968 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:16.851121 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:16.851847 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:16.851855 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:16.851859 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:16.852218 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:16.852382 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:16.853295 (+ 913us) server_negotiation.cc:299] Negotiation successful
0619 06:38:16.853556 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 06:38:16.855095 13140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:16.827231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:45165 (local address 127.10.192.67:53275)
0619 06:38:16.828220 (+ 989us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:16.828279 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:16.831194 (+ 2915us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:16.832633 (+ 1439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:16.832648 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:16.833743 (+ 1095us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:16.834866 (+ 1123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:16.834903 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.836572 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.836577 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:16.838854 (+ 2277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:16.838869 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.839907 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.839918 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:16.840321 (+ 403us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:16.841299 (+ 978us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:16.841341 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:16.845070 (+ 3729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:16.849704 (+ 4634us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:16.849721 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:16.849745 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:16.850750 (+ 1005us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:16.851267 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:16.851275 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:16.851281 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:16.851688 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:16.852386 (+ 698us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:16.852397 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:16.852822 (+ 425us) client_negotiation.cc:769] Sending connection context
0619 06:38:16.853162 (+ 340us) client_negotiation.cc:240] Negotiation successful
0619 06:38:16.853751 (+ 589us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"thread_start_us":384,"threads_started":1}
I20260619 06:38:16.882088 12861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:16.861456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:56849 (local address 127.10.192.126:45165)
0619 06:38:16.861672 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:16.861679 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:16.862487 (+ 808us) server_negotiation.cc:407] Connection header received
0619 06:38:16.862725 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:16.862729 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:16.862800 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:16.862884 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:16.864539 (+ 1655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.866000 (+ 1461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.870250 (+ 4250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.871285 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.871458 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:16.874866 (+ 3408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:16.874876 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:16.874883 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:16.874938 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:16.879109 (+ 4171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:16.880036 (+ 927us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:16.880042 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:16.880046 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:16.880195 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:16.880608 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:16.880612 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:16.880614 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:16.880890 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:16.881046 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:16.881468 (+ 422us) server_negotiation.cc:299] Negotiation successful
0619 06:38:16.881709 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260619 06:38:16.882187 13201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:16.861494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:45165 (local address 127.10.192.67:56849)
0619 06:38:16.862278 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:16.862303 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:16.862588 (+ 285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:16.862948 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:16.862956 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:16.863758 (+ 802us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:16.864309 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:16.864328 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.867945 (+ 3617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.867954 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:16.870003 (+ 2049us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:16.870024 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.871842 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.871854 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:16.872149 (+ 295us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:16.873090 (+ 941us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:16.873123 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:16.874569 (+ 1446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:16.879291 (+ 4722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:16.879296 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:16.879301 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:16.879894 (+ 593us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:16.880316 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:16.880321 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:16.880325 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:16.880479 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:16.881020 (+ 541us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:16.881025 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:16.881211 (+ 186us) client_negotiation.cc:769] Sending connection context
0619 06:38:16.881365 (+ 154us) client_negotiation.cc:240] Negotiation successful
0619 06:38:16.881712 (+ 347us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":386,"threads_started":1}
I20260619 06:38:16.896207 13116 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:38705
I20260619 06:38:16.896237 13250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:38705 every 8 connection(s)
I20260619 06:38:16.897562 13116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:38:16.899858 13251 heartbeater.cc:347] Connected to a master server at 127.10.192.126:45165
I20260619 06:38:16.900115 13251 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:16.900852 13251 heartbeater.cc:511] Master 127.10.192.126:45165 requested a full tablet report, sending...
I20260619 06:38:16.902406 12766 ts_manager.cc:194] Registered new tserver with Master: 638cc9bb76fa4f3f81669bf8f58996ac (127.10.192.67:38705)
I20260619 06:38:16.903249 12766 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:53275
I20260619 06:38:16.906952 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 13116
I20260619 06:38:16.907143 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:38:16.907598 11009 external_mini_cluster.cc:1428] Setting key 97e688472bdde1ac0ceaf0d5a3bd1c3b
I20260619 06:38:16.910779 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 19 06:38:16 dist-test-slave-7lz4 krb5kdc[12721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851096, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 19 06:38:16 dist-test-slave-7lz4 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851096, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:16.959616 12861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:16.944882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47254 (local address 127.10.192.126:45165)
0619 06:38:16.945138 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:16.945145 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:16.945316 (+ 171us) server_negotiation.cc:407] Connection header received
0619 06:38:16.945474 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:16.945478 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:16.945543 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:16.945634 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:16.947076 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.947951 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.949232 (+ 1281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.950359 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.950467 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:16.954431 (+ 3964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:16.954437 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:16.954441 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:16.954480 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:16.957275 (+ 2795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:16.957891 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:16.957895 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:16.957897 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:16.958025 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:16.958391 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:16.958396 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:16.958398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:16.958693 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:16.958886 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:16.959116 (+ 230us) server_negotiation.cc:299] Negotiation successful
0619 06:38:16.959326 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260619 06:38:16.963922 12766 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47254:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:38:16.970760 12766 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:38:16.997133 13264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:16.983921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:42805 (local address 127.0.0.1:53838)
0619 06:38:16.984937 (+ 1016us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:16.984988 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:16.985225 (+ 237us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:16.988904 (+ 3679us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:16.988909 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:16.988929 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:16.989461 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:16.989478 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.991423 (+ 1945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.991429 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:16.994232 (+ 2803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:16.994247 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.995934 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.995949 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:16.996168 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:16.996234 (+ 66us) client_negotiation.cc:769] Sending connection context
0619 06:38:16.996357 (+ 123us) client_negotiation.cc:240] Negotiation successful
0619 06:38:16.996607 (+ 250us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"mutex_wait_us":306,"thread_start_us":440,"threads_started":1}
I20260619 06:38:16.998097 13266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:16.984119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:38705 (local address 127.0.0.1:41746)
0619 06:38:16.987468 (+ 3349us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:16.987485 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:16.987680 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:16.988845 (+ 1165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:16.988855 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:16.988902 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:16.989996 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:16.990015 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.991548 (+ 1533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.991555 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:16.994943 (+ 3388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:16.994962 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.997057 (+ 2095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.997069 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:16.997292 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:16.997328 (+ 36us) client_negotiation.cc:769] Sending connection context
0619 06:38:16.997437 (+ 109us) client_negotiation.cc:240] Negotiation successful
0619 06:38:16.997573 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3191,"mutex_wait_us":203,"thread_start_us":3031,"threads_started":1}
I20260619 06:38:16.998689 13269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:16.986967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41160 (local address 127.10.192.65:42813)
0619 06:38:16.989121 (+ 2154us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:16.989129 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:16.989158 (+ 29us) server_negotiation.cc:407] Connection header received
0619 06:38:16.989253 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:16.989263 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:16.989496 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:16.989719 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:16.990401 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.991942 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.995137 (+ 3195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.996674 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.996816 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:16.997027 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:16.998209 (+ 1182us) server_negotiation.cc:299] Negotiation successful
0619 06:38:16.998384 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1984,"thread_start_us":2059,"threads_started":1}
I20260619 06:38:16.998714 13265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:16.984119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53838 (local address 127.10.192.66:42805)
0619 06:38:16.988218 (+ 4099us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:16.988228 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:16.988273 (+ 45us) server_negotiation.cc:407] Connection header received
0619 06:38:16.988379 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:16.988389 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:16.988682 (+ 293us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:16.989284 (+ 602us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:16.989680 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.991250 (+ 1570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.994423 (+ 3173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.995632 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.997671 (+ 2039us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:16.997891 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:16.997984 (+ 93us) server_negotiation.cc:299] Negotiation successful
0619 06:38:16.998407 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3929,"thread_start_us":3787,"threads_started":1}
I20260619 06:38:16.998126 13268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:16.986407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:42813 (local address 127.0.0.1:41160)
0619 06:38:16.988491 (+ 2084us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:16.988509 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:16.988623 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:16.989718 (+ 1095us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:16.989722 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:16.989751 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:16.990198 (+ 447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:16.990210 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.992120 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.992127 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:16.994943 (+ 2816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:16.994962 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.997192 (+ 2230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.997199 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:16.997404 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:16.997437 (+ 33us) client_negotiation.cc:769] Sending connection context
0619 06:38:16.997538 (+ 101us) client_negotiation.cc:240] Negotiation successful
0619 06:38:16.997679 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1961,"mutex_wait_us":164,"thread_start_us":1903,"threads_started":1}
I20260619 06:38:16.999027 13267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:16.984573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41746 (local address 127.10.192.67:38705)
0619 06:38:16.986938 (+ 2365us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:16.986953 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:16.987603 (+ 650us) server_negotiation.cc:407] Connection header received
0619 06:38:16.987897 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:16.987910 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:16.988213 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:16.988437 (+ 224us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:16.990235 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.991401 (+ 1166us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.995196 (+ 3795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:16.996423 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:16.996601 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:16.996875 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:16.998503 (+ 1628us) server_negotiation.cc:299] Negotiation successful
0619 06:38:16.998642 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2128,"thread_start_us":1875,"threads_started":1}
I20260619 06:38:17.002521 13042 tablet_service.cc:1467] Processing CreateTablet for tablet 53d744b184bf4f8883f81eba5a971edc (DEFAULT_TABLE table=test-table [id=f9f80eee81bf4669a50916e4c86756d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:17.002566 13181 tablet_service.cc:1467] Processing CreateTablet for tablet 53d744b184bf4f8883f81eba5a971edc (DEFAULT_TABLE table=test-table [id=f9f80eee81bf4669a50916e4c86756d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:17.002566 12903 tablet_service.cc:1467] Processing CreateTablet for tablet 53d744b184bf4f8883f81eba5a971edc (DEFAULT_TABLE table=test-table [id=f9f80eee81bf4669a50916e4c86756d5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:17.004029 13042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53d744b184bf4f8883f81eba5a971edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:17.004033 12903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53d744b184bf4f8883f81eba5a971edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:17.004052 13181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53d744b184bf4f8883f81eba5a971edc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:17.018715 13270 tablet_bootstrap.cc:492] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd: Bootstrap starting.
I20260619 06:38:17.021100 13271 tablet_bootstrap.cc:492] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1: Bootstrap starting.
I20260619 06:38:17.021971 13272 tablet_bootstrap.cc:492] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac: Bootstrap starting.
I20260619 06:38:17.023837 13270 tablet_bootstrap.cc:654] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:17.025255 13270 log.cc:824] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:17.025791 13271 tablet_bootstrap.cc:654] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:17.026829 13272 tablet_bootstrap.cc:654] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:17.027082 13271 log.cc:824] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:17.028012 13272 log.cc:824] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:17.029086 13270 tablet_bootstrap.cc:492] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd: No bootstrap required, opened a new log
I20260619 06:38:17.029376 13270 ts_tablet_manager.cc:1397] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.004s
I20260619 06:38:17.030222 13271 tablet_bootstrap.cc:492] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1: No bootstrap required, opened a new log
I20260619 06:38:17.030499 13271 ts_tablet_manager.cc:1397] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260619 06:38:17.030740 13272 tablet_bootstrap.cc:492] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac: No bootstrap required, opened a new log
I20260619 06:38:17.031255 13272 ts_tablet_manager.cc:1397] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260619 06:38:17.038789 13272 raft_consensus.cc:348] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } }
I20260619 06:38:17.039225 13272 raft_consensus.cc:374] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:17.039332 13272 raft_consensus.cc:729] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 638cc9bb76fa4f3f81669bf8f58996ac, State: Initialized, Role: FOLLOWER
I20260619 06:38:17.040028 13272 consensus_queue.cc:260] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } }
I20260619 06:38:17.041299 13251 heartbeater.cc:503] Master 127.10.192.126:45165 was elected leader, sending a full tablet report...
I20260619 06:38:17.041214 13271 raft_consensus.cc:348] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } }
I20260619 06:38:17.041713 13271 raft_consensus.cc:374] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:17.041808 13271 raft_consensus.cc:729] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504427d18ad64c629a25b5e936dc80e1, State: Initialized, Role: FOLLOWER
I20260619 06:38:17.042029 13272 ts_tablet_manager.cc:1428] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260619 06:38:17.042505 13271 consensus_queue.cc:260] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } }
I20260619 06:38:17.042793 13270 raft_consensus.cc:348] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } }
I20260619 06:38:17.043409 13270 raft_consensus.cc:374] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:17.043524 13270 raft_consensus.cc:729] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 966ce41aae8a49d0933280cc4633f6dd, State: Initialized, Role: FOLLOWER
I20260619 06:38:17.044229 13270 consensus_queue.cc:260] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } }
I20260619 06:38:17.045501 13271 ts_tablet_manager.cc:1428] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1: Time spent starting tablet: real 0.015s user 0.014s sys 0.001s
I20260619 06:38:17.046476 13112 heartbeater.cc:503] Master 127.10.192.126:45165 was elected leader, sending a full tablet report...
I20260619 06:38:17.047251 13270 ts_tablet_manager.cc:1428] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd: Time spent starting tablet: real 0.018s user 0.008s sys 0.008s
W20260619 06:38:17.055019 12974 tablet.cc:2369] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 06:38:17.090364 13113 tablet.cc:2369] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:38:17.145256 13278 raft_consensus.cc:482] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:38:17.145646 13278 raft_consensus.cc:504] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } }
I20260619 06:38:17.147490 13278 leader_election.cc:288] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 638cc9bb76fa4f3f81669bf8f58996ac (127.10.192.67:38705), 504427d18ad64c629a25b5e936dc80e1 (127.10.192.65:42813)
W20260619 06:38:17.149541 13252 tablet.cc:2369] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:38:17.153479 13276 raft_consensus.cc:482] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:38:17.153784 13276 raft_consensus.cc:504] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } }
I20260619 06:38:17.155511 13269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:17.147924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:56047 (local address 127.10.192.65:42813)
0619 06:38:17.148142 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:17.148148 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:17.149292 (+ 1144us) server_negotiation.cc:407] Connection header received
0619 06:38:17.149613 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:17.149618 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:17.149696 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:17.149783 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:17.150506 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.151321 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.153701 (+ 2380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.154578 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.154756 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:17.154838 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:17.155127 (+ 289us) server_negotiation.cc:299] Negotiation successful
0619 06:38:17.155251 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 06:38:17.155805 13280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:17.148139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:42813 (local address 127.10.192.66:56047)
0619 06:38:17.149170 (+ 1031us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:17.149184 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:17.149422 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:17.149949 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:17.149954 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:17.149976 (+ 22us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:17.150332 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:17.150344 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.151456 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.151461 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:17.153554 (+ 2093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:17.153563 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.154792 (+ 1229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.154798 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:17.154964 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:17.154988 (+ 24us) client_negotiation.cc:769] Sending connection context
0619 06:38:17.155098 (+ 110us) client_negotiation.cc:240] Negotiation successful
0619 06:38:17.155243 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":910,"thread_start_us":672,"threads_started":1}
I20260619 06:38:17.155990 13267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:17.147924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:35741 (local address 127.10.192.67:38705)
0619 06:38:17.148137 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:17.148143 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:17.148762 (+ 619us) server_negotiation.cc:407] Connection header received
0619 06:38:17.149001 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:17.149007 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:17.149076 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:17.149172 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:17.149835 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.150845 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.153504 (+ 2659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.154765 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.154961 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:17.155033 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:17.155567 (+ 534us) server_negotiation.cc:299] Negotiation successful
0619 06:38:17.155736 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260619 06:38:17.156000 13276 leader_election.cc:288] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 966ce41aae8a49d0933280cc4633f6dd (127.10.192.66:42805), 504427d18ad64c629a25b5e936dc80e1 (127.10.192.65:42813)
I20260619 06:38:17.156867 13279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:17.147976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:38705 (local address 127.10.192.66:35741)
0619 06:38:17.148641 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:17.148658 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:17.148843 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:17.149229 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:17.149234 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:17.149261 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:17.149662 (+ 401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:17.149674 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.150984 (+ 1310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.150990 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:17.153341 (+ 2351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:17.153355 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.155181 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.155187 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:17.155379 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:17.155412 (+ 33us) client_negotiation.cc:769] Sending connection context
0619 06:38:17.156232 (+ 820us) client_negotiation.cc:240] Negotiation successful
0619 06:38:17.156382 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"mutex_wait_us":80,"spinlock_wait_cycles":2432,"thread_start_us":305,"threads_started":1}
I20260619 06:38:17.157214 12923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53d744b184bf4f8883f81eba5a971edc" candidate_uuid: "966ce41aae8a49d0933280cc4633f6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504427d18ad64c629a25b5e936dc80e1" is_pre_election: true
I20260619 06:38:17.157764 12923 raft_consensus.cc:2454] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 966ce41aae8a49d0933280cc4633f6dd in term 0.
I20260619 06:38:17.158551 12995 leader_election.cc:302] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504427d18ad64c629a25b5e936dc80e1, 966ce41aae8a49d0933280cc4633f6dd; no voters:
I20260619 06:38:17.159427 13278 raft_consensus.cc:2781] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:38:17.159592 13278 raft_consensus.cc:482] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:38:17.159725 13278 raft_consensus.cc:3037] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:17.159566 13206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53d744b184bf4f8883f81eba5a971edc" candidate_uuid: "966ce41aae8a49d0933280cc4633f6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" is_pre_election: true
I20260619 06:38:17.160212 13206 raft_consensus.cc:2454] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 966ce41aae8a49d0933280cc4633f6dd in term 0.
I20260619 06:38:17.163540 13278 raft_consensus.cc:504] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } }
I20260619 06:38:17.164824 13206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53d744b184bf4f8883f81eba5a971edc" candidate_uuid: "966ce41aae8a49d0933280cc4633f6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "638cc9bb76fa4f3f81669bf8f58996ac"
I20260619 06:38:17.164860 12923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53d744b184bf4f8883f81eba5a971edc" candidate_uuid: "966ce41aae8a49d0933280cc4633f6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504427d18ad64c629a25b5e936dc80e1"
I20260619 06:38:17.165064 12923 raft_consensus.cc:3037] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:17.165064 13206 raft_consensus.cc:3037] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:17.165271 13265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:17.156613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:50907 (local address 127.10.192.66:42805)
0619 06:38:17.156984 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:17.156990 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:17.157008 (+ 18us) server_negotiation.cc:407] Connection header received
0619 06:38:17.157365 (+ 357us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:17.157373 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:17.157484 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:17.157580 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:17.158282 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.159783 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.162583 (+ 2800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.163960 (+ 1377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.164077 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:17.164127 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:17.164896 (+ 769us) server_negotiation.cc:299] Negotiation successful
0619 06:38:17.165022 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":223}
I20260619 06:38:17.165794 13140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:17.156251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:42805 (local address 127.10.192.67:50907)
0619 06:38:17.156862 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:17.156882 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:17.156990 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:17.157772 (+ 782us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:17.157781 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:17.157825 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:17.158090 (+ 265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:17.158104 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.160008 (+ 1904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.160017 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:17.162369 (+ 2352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:17.162387 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.164279 (+ 1892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.164284 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:17.164524 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:17.164559 (+ 35us) client_negotiation.cc:769] Sending connection context
0619 06:38:17.164653 (+ 94us) client_negotiation.cc:240] Negotiation successful
0619 06:38:17.164801 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"mutex_wait_us":25}
I20260619 06:38:17.167742 12923 raft_consensus.cc:2454] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 966ce41aae8a49d0933280cc4633f6dd in term 1.
I20260619 06:38:17.168021 13278 leader_election.cc:288] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [CANDIDATE]: Term 1 election: Requested vote from peers 638cc9bb76fa4f3f81669bf8f58996ac (127.10.192.67:38705), 504427d18ad64c629a25b5e936dc80e1 (127.10.192.65:42813)
I20260619 06:38:17.168268 12995 leader_election.cc:302] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504427d18ad64c629a25b5e936dc80e1, 966ce41aae8a49d0933280cc4633f6dd; no voters:
I20260619 06:38:17.168339 13206 raft_consensus.cc:2454] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 966ce41aae8a49d0933280cc4633f6dd in term 1.
I20260619 06:38:17.168617 13269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:17.158674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:43503 (local address 127.10.192.65:42813)
0619 06:38:17.159290 (+ 616us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:17.159295 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:17.161393 (+ 2098us) server_negotiation.cc:407] Connection header received
0619 06:38:17.161593 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:17.161598 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:17.161668 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:17.161751 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:17.162433 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.163556 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.166021 (+ 2465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.167419 (+ 1398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.167598 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:17.167706 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:17.168217 (+ 511us) server_negotiation.cc:299] Negotiation successful
0619 06:38:17.168365 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491}
I20260619 06:38:17.168646 13281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:17.156663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:42813 (local address 127.10.192.67:43503)
0619 06:38:17.161263 (+ 4600us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:17.161283 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:17.161431 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:17.161788 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:17.161793 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:17.161824 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:17.162253 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:17.162266 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.163732 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.163738 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:17.165771 (+ 2033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:17.165790 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.167708 (+ 1918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.167717 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:17.167907 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:17.167948 (+ 41us) client_negotiation.cc:769] Sending connection context
0619 06:38:17.168052 (+ 104us) client_negotiation.cc:240] Negotiation successful
0619 06:38:17.168196 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4472,"mutex_wait_us":3,"thread_start_us":4270,"threads_started":1}
I20260619 06:38:17.168910 13278 raft_consensus.cc:2781] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:17.169420 13278 raft_consensus.cc:686] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [term 1 LEADER]: Becoming Leader. State: Replica: 966ce41aae8a49d0933280cc4633f6dd, State: Running, Role: LEADER
I20260619 06:38:17.169708 12923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53d744b184bf4f8883f81eba5a971edc" candidate_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504427d18ad64c629a25b5e936dc80e1" is_pre_election: true
I20260619 06:38:17.170011 12923 raft_consensus.cc:2379] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 638cc9bb76fa4f3f81669bf8f58996ac in current term 1: Already voted for candidate 966ce41aae8a49d0933280cc4633f6dd in this term.
I20260619 06:38:17.169912 13067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53d744b184bf4f8883f81eba5a971edc" candidate_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "966ce41aae8a49d0933280cc4633f6dd" is_pre_election: true
I20260619 06:38:17.170913 13278 consensus_queue.cc:237] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } }
I20260619 06:38:17.171156 13134 leader_election.cc:302] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 638cc9bb76fa4f3f81669bf8f58996ac; no voters: 504427d18ad64c629a25b5e936dc80e1, 966ce41aae8a49d0933280cc4633f6dd
I20260619 06:38:17.171594 13276 raft_consensus.cc:2726] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260619 06:38:17.176100 12765 catalog_manager.cc:5495] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 966ce41aae8a49d0933280cc4633f6dd (127.10.192.66). New cstate: current_term: 1 leader_uuid: "966ce41aae8a49d0933280cc4633f6dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } health_report { overall_health: UNKNOWN } } }
Jun 19 06:38:17 dist-test-slave-7lz4 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851095, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:17.220085 12861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:17.206443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47270 (local address 127.10.192.126:45165)
0619 06:38:17.206669 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:17.206677 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:17.207263 (+ 586us) server_negotiation.cc:407] Connection header received
0619 06:38:17.207400 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:17.207405 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:17.207494 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:17.207581 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:17.208800 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.209580 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.210828 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.211349 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.211455 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:17.214860 (+ 3405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:17.214864 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:17.214867 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:17.214910 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:17.217654 (+ 2744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:17.218327 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:17.218338 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:17.218341 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:17.218467 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:17.218775 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:17.218778 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:17.218780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:17.219050 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:17.219157 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:17.219557 (+ 400us) server_negotiation.cc:299] Negotiation successful
0619 06:38:17.219819 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":87,"server-negotiator.queue_time_us":90}
I20260619 06:38:17.220088 13289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:17.206534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:45165 (local address 127.0.0.1:47270)
0619 06:38:17.207151 (+ 617us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:17.207167 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:17.207295 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:17.207623 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:17.207627 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:17.208372 (+ 745us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:17.208634 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:17.208643 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.209693 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.209697 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:17.210706 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:17.210717 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.211668 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.211679 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:17.211809 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:17.212488 (+ 679us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:17.212516 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:17.214671 (+ 2155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:17.217777 (+ 3106us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:17.217787 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:17.217792 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:17.218228 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:17.218559 (+ 331us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:17.218562 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:17.218564 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:17.218689 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:17.219172 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:17.219179 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:17.219322 (+ 143us) client_negotiation.cc:769] Sending connection context
0619 06:38:17.219458 (+ 136us) client_negotiation.cc:240] Negotiation successful
0619 06:38:17.219711 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":479,"thread_start_us":352,"threads_started":1}
I20260619 06:38:17.225193 12765 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:47270:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260619 06:38:17.226207 12765 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:38:17.233034 13042 tablet_service.cc:1467] Processing CreateTablet for tablet 8f71e8af1078418abe823a58c486cd4c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=34a54d8d0ff04418937852ce6a7e3d9c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 06:38:17.232836 12903 tablet_service.cc:1467] Processing CreateTablet for tablet 8f71e8af1078418abe823a58c486cd4c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=34a54d8d0ff04418937852ce6a7e3d9c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 06:38:17.233161 13181 tablet_service.cc:1467] Processing CreateTablet for tablet 8f71e8af1078418abe823a58c486cd4c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=34a54d8d0ff04418937852ce6a7e3d9c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 06:38:17.233877 12903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f71e8af1078418abe823a58c486cd4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:17.233877 13042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f71e8af1078418abe823a58c486cd4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:17.233901 13181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f71e8af1078418abe823a58c486cd4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:17.239169 13272 tablet_bootstrap.cc:492] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac: Bootstrap starting.
I20260619 06:38:17.240784 13272 tablet_bootstrap.cc:654] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:17.241024 13270 tablet_bootstrap.cc:492] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd: Bootstrap starting.
I20260619 06:38:17.241684 13271 tablet_bootstrap.cc:492] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1: Bootstrap starting.
I20260619 06:38:17.242800 13270 tablet_bootstrap.cc:654] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:17.243443 13271 tablet_bootstrap.cc:654] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:17.243673 13272 tablet_bootstrap.cc:492] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac: No bootstrap required, opened a new log
I20260619 06:38:17.243897 13272 ts_tablet_manager.cc:1397] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260619 06:38:17.244601 13272 raft_consensus.cc:348] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:17.244858 13272 raft_consensus.cc:374] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:17.244971 13272 raft_consensus.cc:729] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 638cc9bb76fa4f3f81669bf8f58996ac, State: Initialized, Role: FOLLOWER
I20260619 06:38:17.245107 13270 tablet_bootstrap.cc:492] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd: No bootstrap required, opened a new log
I20260619 06:38:17.245241 13270 ts_tablet_manager.cc:1397] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s
I20260619 06:38:17.245220 13272 consensus_queue.cc:260] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:17.245695 13276 tablet_replica.cc:439] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } }
I20260619 06:38:17.245967 13276 tablet_replica.cc:442] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:38:17.246040 13270 raft_consensus.cc:348] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:17.246250 13270 raft_consensus.cc:374] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:17.246338 13270 raft_consensus.cc:729] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 966ce41aae8a49d0933280cc4633f6dd, State: Initialized, Role: FOLLOWER
I20260619 06:38:17.246454 13272 ts_tablet_manager.cc:1428] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 06:38:17.246622 13270 consensus_queue.cc:260] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:17.247072 13278 tablet_replica.cc:439] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } }
I20260619 06:38:17.247332 13278 tablet_replica.cc:442] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:38:17.248067 13270 ts_tablet_manager.cc:1428] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260619 06:38:17.248785 13271 tablet_bootstrap.cc:492] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1: No bootstrap required, opened a new log
I20260619 06:38:17.249222 13271 ts_tablet_manager.cc:1397] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.002s
I20260619 06:38:17.250084 13271 raft_consensus.cc:348] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:17.250329 13271 raft_consensus.cc:374] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:17.250418 13271 raft_consensus.cc:729] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504427d18ad64c629a25b5e936dc80e1, State: Initialized, Role: FOLLOWER
I20260619 06:38:17.250655 13271 consensus_queue.cc:260] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:17.251221 13271 ts_tablet_manager.cc:1428] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 06:38:17.251073 13277 tablet_replica.cc:439] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } }
I20260619 06:38:17.251446 13277 tablet_replica.cc:442] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:38:17.326246 13277 raft_consensus.cc:482] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:38:17.326551 13277 raft_consensus.cc:504] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:17.328197 13277 leader_election.cc:288] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 966ce41aae8a49d0933280cc4633f6dd (127.10.192.66:42805), 638cc9bb76fa4f3f81669bf8f58996ac (127.10.192.67:38705)
I20260619 06:38:17.331532 13278 raft_consensus.cc:482] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:38:17.331784 13278 raft_consensus.cc:504] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:17.332451 13278 leader_election.cc:288] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 504427d18ad64c629a25b5e936dc80e1 (127.10.192.65:42813), 638cc9bb76fa4f3f81669bf8f58996ac (127.10.192.67:38705)
I20260619 06:38:17.333093 12923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f71e8af1078418abe823a58c486cd4c" candidate_uuid: "966ce41aae8a49d0933280cc4633f6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504427d18ad64c629a25b5e936dc80e1" is_pre_election: true
I20260619 06:38:17.333345 12923 raft_consensus.cc:2454] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 966ce41aae8a49d0933280cc4633f6dd in term 0.
I20260619 06:38:17.333683 13206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f71e8af1078418abe823a58c486cd4c" candidate_uuid: "966ce41aae8a49d0933280cc4633f6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" is_pre_election: true
I20260619 06:38:17.333947 13206 raft_consensus.cc:2454] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 966ce41aae8a49d0933280cc4633f6dd in term 0.
I20260619 06:38:17.334503 12995 leader_election.cc:302] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504427d18ad64c629a25b5e936dc80e1, 966ce41aae8a49d0933280cc4633f6dd; no voters:
I20260619 06:38:17.335136 13278 raft_consensus.cc:2781] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:38:17.335250 13278 raft_consensus.cc:482] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:38:17.335345 13278 raft_consensus.cc:3037] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:17.337069 13267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:17.328637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:56145 (local address 127.10.192.67:38705)
0619 06:38:17.328826 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:17.328833 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:17.329533 (+ 700us) server_negotiation.cc:407] Connection header received
0619 06:38:17.329745 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:17.329748 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:17.329814 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:17.329943 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:17.330637 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.331464 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.334390 (+ 2926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.335671 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.335798 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:17.335884 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:17.336641 (+ 757us) server_negotiation.cc:299] Negotiation successful
0619 06:38:17.336778 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260619 06:38:17.337080 13265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:17.328612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:53473 (local address 127.10.192.66:42805)
0619 06:38:17.328825 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:17.328833 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:17.329659 (+ 826us) server_negotiation.cc:407] Connection header received
0619 06:38:17.329843 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:17.329847 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:17.329903 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:17.329995 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:17.330615 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.331341 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.334343 (+ 3002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.335779 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.335907 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:17.335978 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:17.336641 (+ 663us) server_negotiation.cc:299] Negotiation successful
0619 06:38:17.336778 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260619 06:38:17.337849 13293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:17.328531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:38705 (local address 127.10.192.65:56145)
0619 06:38:17.329364 (+ 833us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:17.329388 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:17.329561 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:17.329960 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:17.329964 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:17.329992 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:17.330476 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:17.330489 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.331597 (+ 1108us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.331602 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:17.334225 (+ 2623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:17.334239 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.336158 (+ 1919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.336170 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:17.336436 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:17.336485 (+ 49us) client_negotiation.cc:769] Sending connection context
0619 06:38:17.337284 (+ 799us) client_negotiation.cc:240] Negotiation successful
0619 06:38:17.337389 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":659,"mutex_wait_us":160,"thread_start_us":460,"threads_started":1}
I20260619 06:38:17.337884 13294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:17.328704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:42805 (local address 127.10.192.65:53473)
0619 06:38:17.329570 (+ 866us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:17.329585 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:17.329689 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:17.330022 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:17.330026 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:17.330055 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:17.330434 (+ 379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:17.330452 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.331483 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.331488 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:17.334154 (+ 2666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:17.334171 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.336181 (+ 2010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.336186 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:17.336438 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:17.336494 (+ 56us) client_negotiation.cc:769] Sending connection context
0619 06:38:17.337236 (+ 742us) client_negotiation.cc:240] Negotiation successful
0619 06:38:17.337382 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":741,"mutex_wait_us":197,"thread_start_us":527,"threads_started":1}
I20260619 06:38:17.338640 13067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f71e8af1078418abe823a58c486cd4c" candidate_uuid: "504427d18ad64c629a25b5e936dc80e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "966ce41aae8a49d0933280cc4633f6dd" is_pre_election: true
I20260619 06:38:17.339036 13206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f71e8af1078418abe823a58c486cd4c" candidate_uuid: "504427d18ad64c629a25b5e936dc80e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" is_pre_election: true
I20260619 06:38:17.338980 13278 raft_consensus.cc:504] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:17.339275 13206 raft_consensus.cc:2454] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 504427d18ad64c629a25b5e936dc80e1 in term 0.
I20260619 06:38:17.339447 13067 raft_consensus.cc:2379] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 504427d18ad64c629a25b5e936dc80e1 in current term 1: Already voted for candidate 966ce41aae8a49d0933280cc4633f6dd in this term.
I20260619 06:38:17.339912 12854 leader_election.cc:302] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504427d18ad64c629a25b5e936dc80e1, 638cc9bb76fa4f3f81669bf8f58996ac; no voters:
I20260619 06:38:17.340097 12923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f71e8af1078418abe823a58c486cd4c" candidate_uuid: "966ce41aae8a49d0933280cc4633f6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504427d18ad64c629a25b5e936dc80e1"
I20260619 06:38:17.340309 12923 raft_consensus.cc:3037] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:17.341598 13206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f71e8af1078418abe823a58c486cd4c" candidate_uuid: "966ce41aae8a49d0933280cc4633f6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "638cc9bb76fa4f3f81669bf8f58996ac"
I20260619 06:38:17.341704 13278 leader_election.cc:288] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [CANDIDATE]: Term 1 election: Requested vote from peers 504427d18ad64c629a25b5e936dc80e1 (127.10.192.65:42813), 638cc9bb76fa4f3f81669bf8f58996ac (127.10.192.67:38705)
I20260619 06:38:17.341833 13206 raft_consensus.cc:3037] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:17.343267 12923 raft_consensus.cc:2454] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 966ce41aae8a49d0933280cc4633f6dd in term 1.
I20260619 06:38:17.343477 13277 raft_consensus.cc:2741] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260619 06:38:17.344419 13206 raft_consensus.cc:2454] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 966ce41aae8a49d0933280cc4633f6dd in term 1.
I20260619 06:38:17.344609 12995 leader_election.cc:302] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504427d18ad64c629a25b5e936dc80e1, 966ce41aae8a49d0933280cc4633f6dd; no voters:
I20260619 06:38:17.344887 13278 raft_consensus.cc:2781] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:17.345084 13278 raft_consensus.cc:686] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [term 1 LEADER]: Becoming Leader. State: Replica: 966ce41aae8a49d0933280cc4633f6dd, State: Running, Role: LEADER
I20260619 06:38:17.345345 13278 consensus_queue.cc:237] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:17.346988 13282 tablet_replica.cc:439] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd: TxnStatusTablet state changed. Reason: New leader 966ce41aae8a49d0933280cc4633f6dd. Latest consensus state: current_term: 1 leader_uuid: "966ce41aae8a49d0933280cc4633f6dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } }
I20260619 06:38:17.347355 13282 tablet_replica.cc:442] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd: This TxnStatusTablet replica's current role is: LEADER
I20260619 06:38:17.348779 12765 catalog_manager.cc:5495] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 966ce41aae8a49d0933280cc4633f6dd (127.10.192.66). New cstate: current_term: 1 leader_uuid: "966ce41aae8a49d0933280cc4633f6dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } health_report { overall_health: UNKNOWN } } }
I20260619 06:38:17.354904 13296 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260619 06:38:17.355211 13296 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260619 06:38:17.381145 13289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:17.374449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:42805 (local address 127.0.0.1:53852)
0619 06:38:17.374679 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:17.374700 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:17.374854 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:17.375376 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:17.375379 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:17.375389 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 06:38:17.375538 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:17.375545 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.377044 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.377048 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:17.378075 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:17.378087 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.379147 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.379157 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:17.379365 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:17.379428 (+ 63us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 06:38:17.380654 (+ 1226us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 06:38:17.380684 (+ 30us) client_negotiation.cc:769] Sending connection context
0619 06:38:17.380766 (+ 82us) client_negotiation.cc:240] Negotiation successful
0619 06:38:17.380907 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260619 06:38:17.381253 13265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:17.374472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53852 (local address 127.10.192.66:42805)
0619 06:38:17.374664 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:17.374675 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:17.374784 (+ 109us) server_negotiation.cc:407] Connection header received
0619 06:38:17.375046 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:17.375051 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:17.375179 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:17.375343 (+ 164us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:38:17.375694 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.376883 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.378218 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.378887 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.379050 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:17.379699 (+ 649us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:38:17.380509 (+ 810us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:38:17.380666 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:17.380813 (+ 147us) server_negotiation.cc:299] Negotiation successful
0619 06:38:17.380903 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260619 06:38:17.389554 12923 raft_consensus.cc:1261] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1 [term 1 FOLLOWER]: Refusing update from remote peer 966ce41aae8a49d0933280cc4633f6dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:17.389699 13206 raft_consensus.cc:1261] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac [term 1 FOLLOWER]: Refusing update from remote peer 966ce41aae8a49d0933280cc4633f6dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:17.390509 13282 consensus_queue.cc:1035] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:17.390952 13278 consensus_queue.cc:1035] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:17.398454 13277 tablet_replica.cc:439] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1: TxnStatusTablet state changed. Reason: New leader 966ce41aae8a49d0933280cc4633f6dd. Latest consensus state: current_term: 1 leader_uuid: "966ce41aae8a49d0933280cc4633f6dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } }
I20260619 06:38:17.398769 13277 tablet_replica.cc:442] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:38:17.403671 13282 tablet_replica.cc:439] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "966ce41aae8a49d0933280cc4633f6dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } }
I20260619 06:38:17.403967 13282 tablet_replica.cc:442] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd: This TxnStatusTablet replica's current role is: LEADER
I20260619 06:38:17.404851 13300 mvcc.cc:205] Tried to move back new op lower bound from 7298462094897561600 to 7298462094728699904. Current Snapshot: MvccSnapshot[applied={T|T < 7298462094897561600}]
I20260619 06:38:17.408197 13277 tablet_replica.cc:439] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "966ce41aae8a49d0933280cc4633f6dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } }
I20260619 06:38:17.408464 13277 tablet_replica.cc:442] T 8f71e8af1078418abe823a58c486cd4c P 504427d18ad64c629a25b5e936dc80e1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:38:17.410817 13276 tablet_replica.cc:439] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac: TxnStatusTablet state changed. Reason: New leader 966ce41aae8a49d0933280cc4633f6dd. Latest consensus state: current_term: 1 leader_uuid: "966ce41aae8a49d0933280cc4633f6dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } }
I20260619 06:38:17.411096 13276 tablet_replica.cc:442] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:38:17.415294 13282 tablet_replica.cc:439] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "966ce41aae8a49d0933280cc4633f6dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } }
I20260619 06:38:17.415592 13282 tablet_replica.cc:442] T 8f71e8af1078418abe823a58c486cd4c P 966ce41aae8a49d0933280cc4633f6dd: This TxnStatusTablet replica's current role is: LEADER
I20260619 06:38:17.418244 13276 tablet_replica.cc:439] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "966ce41aae8a49d0933280cc4633f6dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } } }
I20260619 06:38:17.418498 13276 tablet_replica.cc:442] T 8f71e8af1078418abe823a58c486cd4c P 638cc9bb76fa4f3f81669bf8f58996ac: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:38:17.423092 13265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:17.416062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53864 (local address 127.10.192.66:42805)
0619 06:38:17.416273 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:17.416278 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:17.416297 (+ 19us) server_negotiation.cc:407] Connection header received
0619 06:38:17.416360 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:17.416366 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:17.416446 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:17.416537 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:38:17.417120 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.418294 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.421090 (+ 2796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.421694 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.421849 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:17.422372 (+ 523us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:38:17.422512 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:38:17.422582 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:17.422761 (+ 179us) server_negotiation.cc:299] Negotiation successful
0619 06:38:17.422825 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260619 06:38:17.440888 13265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:17.435137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:41889 (local address 127.10.192.66:42805)
0619 06:38:17.435311 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:17.435315 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:17.435972 (+ 657us) server_negotiation.cc:407] Connection header received
0619 06:38:17.436181 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:17.436189 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:17.436262 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:17.436348 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:38:17.436833 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.437601 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.439058 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.439487 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.439631 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:17.440130 (+ 499us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:38:17.440255 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:38:17.440356 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:17.440488 (+ 132us) server_negotiation.cc:299] Negotiation successful
0619 06:38:17.440551 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260619 06:38:17.441144 13310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:17.435096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:42805 (local address 127.10.192.66:41889)
0619 06:38:17.435867 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:17.435883 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:17.436058 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:17.436373 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:17.436378 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:17.436388 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 06:38:17.436689 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:17.436697 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.437730 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.437737 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:17.438908 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:17.438920 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:17.439724 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:17.439730 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:17.439852 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:17.439908 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 06:38:17.440365 (+ 457us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 06:38:17.440377 (+ 12us) client_negotiation.cc:769] Sending connection context
0619 06:38:17.440468 (+ 91us) client_negotiation.cc:240] Negotiation successful
0619 06:38:17.440597 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":380,"threads_started":1}
I20260619 06:38:17.451175 12923 raft_consensus.cc:1261] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1 [term 1 FOLLOWER]: Refusing update from remote peer 966ce41aae8a49d0933280cc4633f6dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:17.451310 13206 raft_consensus.cc:1261] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac [term 1 FOLLOWER]: Refusing update from remote peer 966ce41aae8a49d0933280cc4633f6dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:17.451750 13278 consensus_queue.cc:1035] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:17.452077 13282 consensus_queue.cc:1035] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:17.462862 13299 mvcc.cc:205] Tried to move back new op lower bound from 7298462095155331072 to 7298462094016831488. Current Snapshot: MvccSnapshot[applied={T|T < 7298462095155331072}]
I20260619 06:38:17.516000 12766 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47254:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:38:17.516284 12766 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47254:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:38:17.519814 12766 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5: Sending DeleteTablet for 3 replicas of tablet 53d744b184bf4f8883f81eba5a971edc
I20260619 06:38:17.521008 13042 tablet_service.cc:1514] Processing DeleteTablet for tablet 53d744b184bf4f8883f81eba5a971edc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:17 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:53838
I20260619 06:38:17.521080 13181 tablet_service.cc:1514] Processing DeleteTablet for tablet 53d744b184bf4f8883f81eba5a971edc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:17 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:41746
I20260619 06:38:17.521425 12903 tablet_service.cc:1514] Processing DeleteTablet for tablet 53d744b184bf4f8883f81eba5a971edc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:17 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:41160
I20260619 06:38:17.524523 12766 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47254:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:38:17.525265 12766 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:38:17.535408 13317 tablet_replica.cc:330] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac: stopping tablet replica
I20260619 06:38:17.536006 13317 raft_consensus.cc:2229] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:17.536374 13317 raft_consensus.cc:2258] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:17.537422 12902 tablet_service.cc:1467] Processing CreateTablet for tablet 5803f71958464d7696733830476f5b3d (DEFAULT_TABLE table=test-table [id=6d92ded527964e1fb577198d65030cc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:17.537966 12902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5803f71958464d7696733830476f5b3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:17.538184 13041 tablet_service.cc:1467] Processing CreateTablet for tablet 5803f71958464d7696733830476f5b3d (DEFAULT_TABLE table=test-table [id=6d92ded527964e1fb577198d65030cc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:17.538429 13317 ts_tablet_manager.cc:1905] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:17.538643 13041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5803f71958464d7696733830476f5b3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:17.538249 13181 tablet_service.cc:1467] Processing CreateTablet for tablet 5803f71958464d7696733830476f5b3d (DEFAULT_TABLE table=test-table [id=6d92ded527964e1fb577198d65030cc5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:17.539284 13181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5803f71958464d7696733830476f5b3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:17.543396 13316 tablet_replica.cc:330] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd: stopping tablet replica
I20260619 06:38:17.543918 13316 raft_consensus.cc:2229] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:38:17.544726 13271 tablet_bootstrap.cc:492] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1: Bootstrap starting.
I20260619 06:38:17.545809 13316 raft_consensus.cc:2258] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:17.545961 13270 tablet_bootstrap.cc:492] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd: Bootstrap starting.
I20260619 06:38:17.546454 13271 tablet_bootstrap.cc:654] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:17.547894 13270 tablet_bootstrap.cc:654] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:17.553210 13316 ts_tablet_manager.cc:1905] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:17.553457 13272 tablet_bootstrap.cc:492] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac: Bootstrap starting.
I20260619 06:38:17.555848 13272 tablet_bootstrap.cc:654] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:17.557329 13270 tablet_bootstrap.cc:492] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd: No bootstrap required, opened a new log
I20260619 06:38:17.557542 13270 ts_tablet_manager.cc:1397] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.009s
I20260619 06:38:17.558561 13270 raft_consensus.cc:348] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:17.558878 13270 raft_consensus.cc:374] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:17.558954 13270 raft_consensus.cc:729] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 966ce41aae8a49d0933280cc4633f6dd, State: Initialized, Role: FOLLOWER
I20260619 06:38:17.559296 13270 consensus_queue.cc:260] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:17.560122 13270 ts_tablet_manager.cc:1428] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260619 06:38:17.562424 13318 tablet_replica.cc:330] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1: stopping tablet replica
I20260619 06:38:17.562912 13318 raft_consensus.cc:2229] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:17.563315 13318 raft_consensus.cc:2258] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:17.565393 13318 ts_tablet_manager.cc:1905] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:17.565768 13317 ts_tablet_manager.cc:1918] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 06:38:17.565940 13317 log.cc:1196] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/53d744b184bf4f8883f81eba5a971edc
I20260619 06:38:17.566468 13317 ts_tablet_manager.cc:1939] T 53d744b184bf4f8883f81eba5a971edc P 638cc9bb76fa4f3f81669bf8f58996ac: Deleting consensus metadata
I20260619 06:38:17.566704 13272 tablet_bootstrap.cc:492] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac: No bootstrap required, opened a new log
I20260619 06:38:17.566934 13272 ts_tablet_manager.cc:1397] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.000s
I20260619 06:38:17.567842 13272 raft_consensus.cc:348] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:17.568154 13272 raft_consensus.cc:374] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:17.568282 13272 raft_consensus.cc:729] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 638cc9bb76fa4f3f81669bf8f58996ac, State: Initialized, Role: FOLLOWER
I20260619 06:38:17.568460 12751 catalog_manager.cc:4841] TS 638cc9bb76fa4f3f81669bf8f58996ac (127.10.192.67:38705): tablet 53d744b184bf4f8883f81eba5a971edc (table test-table [id=f9f80eee81bf4669a50916e4c86756d5]) successfully deleted
I20260619 06:38:17.568675 13272 consensus_queue.cc:260] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:17.568815 13271 tablet_bootstrap.cc:492] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1: No bootstrap required, opened a new log
I20260619 06:38:17.569002 13271 ts_tablet_manager.cc:1397] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.009s
I20260619 06:38:17.569777 13271 raft_consensus.cc:348] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:17.570027 13271 raft_consensus.cc:374] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:17.570106 13271 raft_consensus.cc:729] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504427d18ad64c629a25b5e936dc80e1, State: Initialized, Role: FOLLOWER
I20260619 06:38:17.570405 13271 consensus_queue.cc:260] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:17.572042 13271 ts_tablet_manager.cc:1428] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 06:38:17.573215 13318 ts_tablet_manager.cc:1918] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 06:38:17.573228 13316 ts_tablet_manager.cc:1918] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 06:38:17.573369 13318 log.cc:1196] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/53d744b184bf4f8883f81eba5a971edc
I20260619 06:38:17.573407 13316 log.cc:1196] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/53d744b184bf4f8883f81eba5a971edc
I20260619 06:38:17.573920 13318 ts_tablet_manager.cc:1939] T 53d744b184bf4f8883f81eba5a971edc P 504427d18ad64c629a25b5e936dc80e1: Deleting consensus metadata
I20260619 06:38:17.574002 13316 ts_tablet_manager.cc:1939] T 53d744b184bf4f8883f81eba5a971edc P 966ce41aae8a49d0933280cc4633f6dd: Deleting consensus metadata
I20260619 06:38:17.575927 13272 ts_tablet_manager.cc:1428] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s
I20260619 06:38:17.575911 12752 catalog_manager.cc:4841] TS 966ce41aae8a49d0933280cc4633f6dd (127.10.192.66:42805): tablet 53d744b184bf4f8883f81eba5a971edc (table test-table [id=f9f80eee81bf4669a50916e4c86756d5]) successfully deleted
I20260619 06:38:17.576149 12752 catalog_manager.cc:4841] TS 504427d18ad64c629a25b5e936dc80e1 (127.10.192.65:42813): tablet 53d744b184bf4f8883f81eba5a971edc (table test-table [id=f9f80eee81bf4669a50916e4c86756d5]) successfully deleted
I20260619 06:38:17.699970 13278 raft_consensus.cc:482] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:38:17.700227 13278 raft_consensus.cc:504] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:17.701066 13278 leader_election.cc:288] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 504427d18ad64c629a25b5e936dc80e1 (127.10.192.65:42813), 638cc9bb76fa4f3f81669bf8f58996ac (127.10.192.67:38705)
I20260619 06:38:17.701794 12922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5803f71958464d7696733830476f5b3d" candidate_uuid: "966ce41aae8a49d0933280cc4633f6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504427d18ad64c629a25b5e936dc80e1" is_pre_election: true
I20260619 06:38:17.701835 13205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5803f71958464d7696733830476f5b3d" candidate_uuid: "966ce41aae8a49d0933280cc4633f6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" is_pre_election: true
I20260619 06:38:17.702111 12922 raft_consensus.cc:2454] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 966ce41aae8a49d0933280cc4633f6dd in term 0.
I20260619 06:38:17.702113 13205 raft_consensus.cc:2454] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 966ce41aae8a49d0933280cc4633f6dd in term 0.
I20260619 06:38:17.702692 12995 leader_election.cc:302] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 504427d18ad64c629a25b5e936dc80e1, 638cc9bb76fa4f3f81669bf8f58996ac, 966ce41aae8a49d0933280cc4633f6dd; no voters:
I20260619 06:38:17.703152 13278 raft_consensus.cc:2781] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:38:17.703305 13278 raft_consensus.cc:482] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:38:17.703428 13278 raft_consensus.cc:3037] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:17.706223 13278 raft_consensus.cc:504] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:17.706961 13278 leader_election.cc:288] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [CANDIDATE]: Term 1 election: Requested vote from peers 504427d18ad64c629a25b5e936dc80e1 (127.10.192.65:42813), 638cc9bb76fa4f3f81669bf8f58996ac (127.10.192.67:38705)
I20260619 06:38:17.707577 12922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5803f71958464d7696733830476f5b3d" candidate_uuid: "966ce41aae8a49d0933280cc4633f6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "504427d18ad64c629a25b5e936dc80e1"
I20260619 06:38:17.707842 12922 raft_consensus.cc:3037] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:17.707837 13205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5803f71958464d7696733830476f5b3d" candidate_uuid: "966ce41aae8a49d0933280cc4633f6dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "638cc9bb76fa4f3f81669bf8f58996ac"
I20260619 06:38:17.708081 13205 raft_consensus.cc:3037] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:17.710255 13205 raft_consensus.cc:2454] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 966ce41aae8a49d0933280cc4633f6dd in term 1.
I20260619 06:38:17.710817 12994 leader_election.cc:302] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 638cc9bb76fa4f3f81669bf8f58996ac, 966ce41aae8a49d0933280cc4633f6dd; no voters:
I20260619 06:38:17.710984 12922 raft_consensus.cc:2454] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 966ce41aae8a49d0933280cc4633f6dd in term 1.
I20260619 06:38:17.711246 13278 raft_consensus.cc:2781] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:17.711498 13278 raft_consensus.cc:686] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [term 1 LEADER]: Becoming Leader. State: Replica: 966ce41aae8a49d0933280cc4633f6dd, State: Running, Role: LEADER
I20260619 06:38:17.711961 13278 consensus_queue.cc:237] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:17.715238 12766 catalog_manager.cc:5495] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 966ce41aae8a49d0933280cc4633f6dd (127.10.192.66). New cstate: current_term: 1 leader_uuid: "966ce41aae8a49d0933280cc4633f6dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } health_report { overall_health: UNKNOWN } } }
I20260619 06:38:17.770176 12922 raft_consensus.cc:1261] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1 [term 1 FOLLOWER]: Refusing update from remote peer 966ce41aae8a49d0933280cc4633f6dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:17.770460 13205 raft_consensus.cc:1261] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac [term 1 FOLLOWER]: Refusing update from remote peer 966ce41aae8a49d0933280cc4633f6dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:17.770823 13282 consensus_queue.cc:1035] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:17.771095 13278 consensus_queue.cc:1035] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:17.781435 13301 mvcc.cc:205] Tried to move back new op lower bound from 7298462096462147584 to 7298462096230928384. Current Snapshot: MvccSnapshot[applied={T|T < 7298462096462147584}]
W20260619 06:38:17.796553 13299 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260619 06:38:19.386144 12766 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47254:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:38:19.386417 12766 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47254:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:38:19.390555 12766 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5: Sending DeleteTablet for 3 replicas of tablet 5803f71958464d7696733830476f5b3d
I20260619 06:38:19.391485 12903 tablet_service.cc:1514] Processing DeleteTablet for tablet 5803f71958464d7696733830476f5b3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:19 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:41160
I20260619 06:38:19.391485 13181 tablet_service.cc:1514] Processing DeleteTablet for tablet 5803f71958464d7696733830476f5b3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:19 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:41746
I20260619 06:38:19.391561 13042 tablet_service.cc:1514] Processing DeleteTablet for tablet 5803f71958464d7696733830476f5b3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:19 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:53838
I20260619 06:38:19.403354 13346 tablet_replica.cc:330] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd: stopping tablet replica
I20260619 06:38:19.403648 13346 raft_consensus.cc:2229] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:38:19.403797 13345 tablet_replica.cc:330] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1: stopping tablet replica
I20260619 06:38:19.404039 13345 raft_consensus.cc:2229] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:19.404160 13346 raft_consensus.cc:2258] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:19.404276 13345 raft_consensus.cc:2258] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:19.404626 13344 tablet_replica.cc:330] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac: stopping tablet replica
I20260619 06:38:19.404914 13344 raft_consensus.cc:2229] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:19.405211 13344 raft_consensus.cc:2258] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:19.405280 13346 ts_tablet_manager.cc:1905] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:19.406014 13345 ts_tablet_manager.cc:1905] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:19.406327 13344 ts_tablet_manager.cc:1905] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:19.412478 13346 ts_tablet_manager.cc:1918] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260619 06:38:19.412640 13346 log.cc:1196] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/5803f71958464d7696733830476f5b3d
I20260619 06:38:19.412671 13345 ts_tablet_manager.cc:1918] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260619 06:38:19.412789 13345 log.cc:1196] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/5803f71958464d7696733830476f5b3d
I20260619 06:38:19.413154 13346 ts_tablet_manager.cc:1939] T 5803f71958464d7696733830476f5b3d P 966ce41aae8a49d0933280cc4633f6dd: Deleting consensus metadata
I20260619 06:38:19.413239 13345 ts_tablet_manager.cc:1939] T 5803f71958464d7696733830476f5b3d P 504427d18ad64c629a25b5e936dc80e1: Deleting consensus metadata
I20260619 06:38:19.414320 13344 ts_tablet_manager.cc:1918] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260619 06:38:19.414407 12752 catalog_manager.cc:4841] TS 966ce41aae8a49d0933280cc4633f6dd (127.10.192.66:42805): tablet 5803f71958464d7696733830476f5b3d (table test-table [id=6d92ded527964e1fb577198d65030cc5]) successfully deleted
I20260619 06:38:19.414543 13344 log.cc:1196] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/5803f71958464d7696733830476f5b3d
I20260619 06:38:19.414825 12752 catalog_manager.cc:4841] TS 504427d18ad64c629a25b5e936dc80e1 (127.10.192.65:42813): tablet 5803f71958464d7696733830476f5b3d (table test-table [id=6d92ded527964e1fb577198d65030cc5]) successfully deleted
I20260619 06:38:19.414979 13344 ts_tablet_manager.cc:1939] T 5803f71958464d7696733830476f5b3d P 638cc9bb76fa4f3f81669bf8f58996ac: Deleting consensus metadata
I20260619 06:38:19.416200 12751 catalog_manager.cc:4841] TS 638cc9bb76fa4f3f81669bf8f58996ac (127.10.192.67:38705): tablet 5803f71958464d7696733830476f5b3d (table test-table [id=6d92ded527964e1fb577198d65030cc5]) successfully deleted
Jun 19 06:38:19 dist-test-slave-7lz4 krb5kdc[12721](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851099, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 19 06:38:19 dist-test-slave-7lz4 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851099, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:19.450583 13354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:19.436067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47278 (local address 127.10.192.126:45165)
0619 06:38:19.436691 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:19.436699 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:19.436727 (+ 28us) server_negotiation.cc:407] Connection header received
0619 06:38:19.436971 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:19.436975 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:19.437037 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:19.437159 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:19.438547 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:19.439333 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:19.440704 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:19.441127 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:19.441269 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:19.445458 (+ 4189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:19.445465 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:19.445469 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:19.445508 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:19.448084 (+ 2576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:19.448799 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:19.448803 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:19.448805 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:19.449004 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:19.449317 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:19.449320 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:19.449322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:19.449580 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:19.449760 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:19.450067 (+ 307us) server_negotiation.cc:299] Negotiation successful
0619 06:38:19.450238 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":491,"thread_start_us":333,"threads_started":1}
I20260619 06:38:19.454440 12766 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47278:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:38:19.455120 12766 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:38:19.462201 12903 tablet_service.cc:1467] Processing CreateTablet for tablet ff736f41c8a5424e9e7d30e385c68bcd (DEFAULT_TABLE table=test-table [id=95438fc33fb647e2a891734b9ffcb013]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:19.462297 13042 tablet_service.cc:1467] Processing CreateTablet for tablet ff736f41c8a5424e9e7d30e385c68bcd (DEFAULT_TABLE table=test-table [id=95438fc33fb647e2a891734b9ffcb013]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:19.462654 12903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff736f41c8a5424e9e7d30e385c68bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:19.462774 13042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff736f41c8a5424e9e7d30e385c68bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:19.467805 13355 tablet_bootstrap.cc:492] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1: Bootstrap starting.
I20260619 06:38:19.467828 13181 tablet_service.cc:1467] Processing CreateTablet for tablet ff736f41c8a5424e9e7d30e385c68bcd (DEFAULT_TABLE table=test-table [id=95438fc33fb647e2a891734b9ffcb013]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:19.468262 13181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff736f41c8a5424e9e7d30e385c68bcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:19.469177 13356 tablet_bootstrap.cc:492] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd: Bootstrap starting.
I20260619 06:38:19.469833 13355 tablet_bootstrap.cc:654] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:19.470742 13356 tablet_bootstrap.cc:654] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:19.472268 13355 tablet_bootstrap.cc:492] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1: No bootstrap required, opened a new log
I20260619 06:38:19.472522 13355 ts_tablet_manager.cc:1397] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s
I20260619 06:38:19.473104 13356 tablet_bootstrap.cc:492] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd: No bootstrap required, opened a new log
I20260619 06:38:19.473281 13356 ts_tablet_manager.cc:1397] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260619 06:38:19.473321 13355 raft_consensus.cc:348] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:19.473614 13355 raft_consensus.cc:374] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:19.473711 13355 raft_consensus.cc:729] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504427d18ad64c629a25b5e936dc80e1, State: Initialized, Role: FOLLOWER
I20260619 06:38:19.473932 13355 consensus_queue.cc:260] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:19.474073 13356 raft_consensus.cc:348] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:19.474331 13356 raft_consensus.cc:374] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:19.474450 13356 raft_consensus.cc:729] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 966ce41aae8a49d0933280cc4633f6dd, State: Initialized, Role: FOLLOWER
I20260619 06:38:19.474709 13356 consensus_queue.cc:260] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:19.475260 13356 ts_tablet_manager.cc:1428] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260619 06:38:19.476217 13360 tablet_bootstrap.cc:492] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac: Bootstrap starting.
I20260619 06:38:19.476516 13355 ts_tablet_manager.cc:1428] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260619 06:38:19.477957 13360 tablet_bootstrap.cc:654] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:19.480278 13360 tablet_bootstrap.cc:492] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac: No bootstrap required, opened a new log
I20260619 06:38:19.480443 13360 ts_tablet_manager.cc:1397] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260619 06:38:19.481254 13360 raft_consensus.cc:348] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:19.481470 13360 raft_consensus.cc:374] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:19.481563 13360 raft_consensus.cc:729] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 638cc9bb76fa4f3f81669bf8f58996ac, State: Initialized, Role: FOLLOWER
I20260619 06:38:19.481817 13360 consensus_queue.cc:260] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:19.482568 13360 ts_tablet_manager.cc:1428] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260619 06:38:19.645994 13359 raft_consensus.cc:482] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:38:19.646263 13359 raft_consensus.cc:504] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:19.647006 13359 leader_election.cc:288] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 966ce41aae8a49d0933280cc4633f6dd (127.10.192.66:42805), 638cc9bb76fa4f3f81669bf8f58996ac (127.10.192.67:38705)
I20260619 06:38:19.647614 13067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff736f41c8a5424e9e7d30e385c68bcd" candidate_uuid: "504427d18ad64c629a25b5e936dc80e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "966ce41aae8a49d0933280cc4633f6dd" is_pre_election: true
I20260619 06:38:19.647678 13205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff736f41c8a5424e9e7d30e385c68bcd" candidate_uuid: "504427d18ad64c629a25b5e936dc80e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" is_pre_election: true
I20260619 06:38:19.647948 13067 raft_consensus.cc:2454] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 504427d18ad64c629a25b5e936dc80e1 in term 0.
I20260619 06:38:19.647998 13205 raft_consensus.cc:2454] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 504427d18ad64c629a25b5e936dc80e1 in term 0.
I20260619 06:38:19.648499 12855 leader_election.cc:302] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504427d18ad64c629a25b5e936dc80e1, 966ce41aae8a49d0933280cc4633f6dd; no voters:
I20260619 06:38:19.648818 13359 raft_consensus.cc:2781] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:38:19.648969 13359 raft_consensus.cc:482] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:38:19.649080 13359 raft_consensus.cc:3037] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:19.651355 13359 raft_consensus.cc:504] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:19.652045 13359 leader_election.cc:288] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [CANDIDATE]: Term 1 election: Requested vote from peers 966ce41aae8a49d0933280cc4633f6dd (127.10.192.66:42805), 638cc9bb76fa4f3f81669bf8f58996ac (127.10.192.67:38705)
I20260619 06:38:19.652532 13067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff736f41c8a5424e9e7d30e385c68bcd" candidate_uuid: "504427d18ad64c629a25b5e936dc80e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "966ce41aae8a49d0933280cc4633f6dd"
I20260619 06:38:19.652572 13205 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff736f41c8a5424e9e7d30e385c68bcd" candidate_uuid: "504427d18ad64c629a25b5e936dc80e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "638cc9bb76fa4f3f81669bf8f58996ac"
I20260619 06:38:19.652771 13067 raft_consensus.cc:3037] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:19.652765 13205 raft_consensus.cc:3037] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:19.654820 13067 raft_consensus.cc:2454] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 504427d18ad64c629a25b5e936dc80e1 in term 1.
I20260619 06:38:19.654851 13205 raft_consensus.cc:2454] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 504427d18ad64c629a25b5e936dc80e1 in term 1.
I20260619 06:38:19.655316 12854 leader_election.cc:302] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504427d18ad64c629a25b5e936dc80e1, 638cc9bb76fa4f3f81669bf8f58996ac; no voters:
I20260619 06:38:19.655771 13359 raft_consensus.cc:2781] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:19.656286 13359 raft_consensus.cc:686] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [term 1 LEADER]: Becoming Leader. State: Replica: 504427d18ad64c629a25b5e936dc80e1, State: Running, Role: LEADER
I20260619 06:38:19.656704 13359 consensus_queue.cc:237] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:19.660348 12766 catalog_manager.cc:5495] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 504427d18ad64c629a25b5e936dc80e1 (127.10.192.65). New cstate: current_term: 1 leader_uuid: "504427d18ad64c629a25b5e936dc80e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } health_report { overall_health: UNKNOWN } } }
I20260619 06:38:19.722885 13366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:19.717165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41164 (local address 127.10.192.65:42813)
0619 06:38:19.717774 (+ 609us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:19.717811 (+ 37us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:19.717829 (+ 18us) server_negotiation.cc:407] Connection header received
0619 06:38:19.717916 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:19.717919 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:19.718066 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:19.718256 (+ 190us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:38:19.718625 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:19.719379 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:19.720722 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:19.721166 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:19.721265 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:19.721732 (+ 467us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:38:19.722332 (+ 600us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:38:19.722451 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:19.722562 (+ 111us) server_negotiation.cc:299] Negotiation successful
0619 06:38:19.722635 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":327,"threads_started":1}
I20260619 06:38:19.738654 13369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:19.732964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:43733 (local address 127.10.192.66:42805)
0619 06:38:19.733600 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:19.733605 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:19.733746 (+ 141us) server_negotiation.cc:407] Connection header received
0619 06:38:19.733974 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:19.733977 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:19.734076 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:19.734223 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:38:19.734914 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:19.735874 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:19.737194 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:19.737575 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:19.737664 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:19.738061 (+ 397us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:38:19.738159 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:38:19.738225 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:19.738342 (+ 117us) server_negotiation.cc:299] Negotiation successful
0619 06:38:19.738403 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":348,"threads_started":1}
I20260619 06:38:19.738685 13370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:19.732987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:42805 (local address 127.10.192.65:43733)
0619 06:38:19.733650 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:19.733667 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:19.733853 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:19.734322 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:19.734326 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:19.734337 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 06:38:19.734723 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:19.734735 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:19.735995 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:19.735999 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:19.737077 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:19.737088 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:19.737701 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:19.737705 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:19.737821 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:19.737879 (+ 58us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 06:38:19.738241 (+ 362us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 06:38:19.738249 (+ 8us) client_negotiation.cc:769] Sending connection context
0619 06:38:19.738308 (+ 59us) client_negotiation.cc:240] Negotiation successful
0619 06:38:19.738412 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":345,"threads_started":1}
I20260619 06:38:19.747548 13205 raft_consensus.cc:1261] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac [term 1 FOLLOWER]: Refusing update from remote peer 504427d18ad64c629a25b5e936dc80e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:19.748026 13067 raft_consensus.cc:1261] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd [term 1 FOLLOWER]: Refusing update from remote peer 504427d18ad64c629a25b5e936dc80e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:19.748190 13363 consensus_queue.cc:1035] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:19.748715 13359 consensus_queue.cc:1035] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:19.789011 13366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:19.783297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:50269 (local address 127.10.192.65:42813)
0619 06:38:19.783527 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:19.783534 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:19.783881 (+ 347us) server_negotiation.cc:407] Connection header received
0619 06:38:19.784098 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:19.784102 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:19.784165 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:19.784255 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:38:19.784698 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:19.785557 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:19.787489 (+ 1932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:19.787954 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:19.788052 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:19.788397 (+ 345us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:38:19.788508 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:38:19.788577 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:19.788695 (+ 118us) server_negotiation.cc:299] Negotiation successful
0619 06:38:19.788759 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260619 06:38:19.789067 13376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:19.783194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:42813 (local address 127.10.192.66:50269)
0619 06:38:19.783778 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:19.783793 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:19.783954 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:19.784284 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:19.784288 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:19.784299 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 06:38:19.784536 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:19.784544 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:19.785735 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:19.785741 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:19.787336 (+ 1595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:19.787352 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:19.788102 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:19.788106 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:19.788222 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:19.788258 (+ 36us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 06:38:19.788592 (+ 334us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 06:38:19.788599 (+ 7us) client_negotiation.cc:769] Sending connection context
0619 06:38:19.788658 (+ 59us) client_negotiation.cc:240] Negotiation successful
0619 06:38:19.788755 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":467,"thread_start_us":301,"threads_started":1}
I20260619 06:38:19.822798 12764 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:38:19.823066 12764 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:38:19.826892 12764 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5: Sending DeleteTablet for 3 replicas of tablet ff736f41c8a5424e9e7d30e385c68bcd
I20260619 06:38:19.827893 12903 tablet_service.cc:1514] Processing DeleteTablet for tablet ff736f41c8a5424e9e7d30e385c68bcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:19 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:41160
I20260619 06:38:19.828200 13345 tablet_replica.cc:330] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1: stopping tablet replica
I20260619 06:38:19.828150 13181 tablet_service.cc:1514] Processing DeleteTablet for tablet ff736f41c8a5424e9e7d30e385c68bcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:19 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:41746
I20260619 06:38:19.828377 13042 tablet_service.cc:1514] Processing DeleteTablet for tablet ff736f41c8a5424e9e7d30e385c68bcd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:19 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:53838
I20260619 06:38:19.828557 13345 raft_consensus.cc:2229] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:38:19.828732 13344 tablet_replica.cc:330] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac: stopping tablet replica
I20260619 06:38:19.828938 13344 raft_consensus.cc:2229] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:19.829082 13345 raft_consensus.cc:2258] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:19.829118 13344 raft_consensus.cc:2258] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:19.829387 13346 tablet_replica.cc:330] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd: stopping tablet replica
I20260619 06:38:19.829586 13346 raft_consensus.cc:2229] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:19.829779 13346 raft_consensus.cc:2258] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:19.829682 12764 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47278:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:38:19.830382 12764 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:38:19.830440 13345 ts_tablet_manager.cc:1905] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:19.831719 13344 ts_tablet_manager.cc:1905] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:19.835552 13346 ts_tablet_manager.cc:1905] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:19.837947 13345 ts_tablet_manager.cc:1918] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 06:38:19.838157 13345 log.cc:1196] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/ff736f41c8a5424e9e7d30e385c68bcd
I20260619 06:38:19.838596 13345 ts_tablet_manager.cc:1939] T ff736f41c8a5424e9e7d30e385c68bcd P 504427d18ad64c629a25b5e936dc80e1: Deleting consensus metadata
I20260619 06:38:19.839902 12752 catalog_manager.cc:4841] TS 504427d18ad64c629a25b5e936dc80e1 (127.10.192.65:42813): tablet ff736f41c8a5424e9e7d30e385c68bcd (table test-table [id=95438fc33fb647e2a891734b9ffcb013]) successfully deleted
I20260619 06:38:19.845805 12903 tablet_service.cc:1467] Processing CreateTablet for tablet 0e423d7b27ee487991f7d54c3c6a3535 (DEFAULT_TABLE table=test-table [id=d92f982368c34ab8bf48685767538e6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:19.846274 12903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e423d7b27ee487991f7d54c3c6a3535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:19.846271 13181 tablet_service.cc:1467] Processing CreateTablet for tablet 0e423d7b27ee487991f7d54c3c6a3535 (DEFAULT_TABLE table=test-table [id=d92f982368c34ab8bf48685767538e6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:19.846748 13181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e423d7b27ee487991f7d54c3c6a3535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:19.848479 13344 ts_tablet_manager.cc:1918] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 06:38:19.848639 13344 log.cc:1196] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/ff736f41c8a5424e9e7d30e385c68bcd
I20260619 06:38:19.849105 13344 ts_tablet_manager.cc:1939] T ff736f41c8a5424e9e7d30e385c68bcd P 638cc9bb76fa4f3f81669bf8f58996ac: Deleting consensus metadata
I20260619 06:38:19.851212 13042 tablet_service.cc:1467] Processing CreateTablet for tablet 0e423d7b27ee487991f7d54c3c6a3535 (DEFAULT_TABLE table=test-table [id=d92f982368c34ab8bf48685767538e6d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:19.851703 13042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0e423d7b27ee487991f7d54c3c6a3535. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:19.854569 13360 tablet_bootstrap.cc:492] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac: Bootstrap starting.
I20260619 06:38:19.855903 13355 tablet_bootstrap.cc:492] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1: Bootstrap starting.
I20260619 06:38:19.856318 13360 tablet_bootstrap.cc:654] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:19.857923 13355 tablet_bootstrap.cc:654] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:19.859118 13346 ts_tablet_manager.cc:1918] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 06:38:19.859331 13346 log.cc:1196] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/ff736f41c8a5424e9e7d30e385c68bcd
I20260619 06:38:19.859932 13346 ts_tablet_manager.cc:1939] T ff736f41c8a5424e9e7d30e385c68bcd P 966ce41aae8a49d0933280cc4633f6dd: Deleting consensus metadata
I20260619 06:38:19.861137 12752 catalog_manager.cc:4841] TS 966ce41aae8a49d0933280cc4633f6dd (127.10.192.66:42805): tablet ff736f41c8a5424e9e7d30e385c68bcd (table test-table [id=95438fc33fb647e2a891734b9ffcb013]) successfully deleted
I20260619 06:38:19.861891 12751 catalog_manager.cc:4841] TS 638cc9bb76fa4f3f81669bf8f58996ac (127.10.192.67:38705): tablet ff736f41c8a5424e9e7d30e385c68bcd (table test-table [id=95438fc33fb647e2a891734b9ffcb013]) successfully deleted
I20260619 06:38:19.864372 13355 tablet_bootstrap.cc:492] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1: No bootstrap required, opened a new log
I20260619 06:38:19.864585 13355 ts_tablet_manager.cc:1397] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s
I20260619 06:38:19.865017 13360 tablet_bootstrap.cc:492] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac: No bootstrap required, opened a new log
I20260619 06:38:19.865190 13360 ts_tablet_manager.cc:1397] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s
I20260619 06:38:19.865501 13355 raft_consensus.cc:348] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:19.865777 13355 raft_consensus.cc:374] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:19.865865 13355 raft_consensus.cc:729] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 504427d18ad64c629a25b5e936dc80e1, State: Initialized, Role: FOLLOWER
I20260619 06:38:19.865953 13360 raft_consensus.cc:348] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:19.866201 13360 raft_consensus.cc:374] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:19.866285 13360 raft_consensus.cc:729] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 638cc9bb76fa4f3f81669bf8f58996ac, State: Initialized, Role: FOLLOWER
I20260619 06:38:19.866547 13360 consensus_queue.cc:260] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:19.867226 13360 ts_tablet_manager.cc:1428] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 06:38:19.867580 13355 consensus_queue.cc:260] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:19.868325 13355 ts_tablet_manager.cc:1428] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260619 06:38:19.869558 13356 tablet_bootstrap.cc:492] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd: Bootstrap starting.
I20260619 06:38:19.871374 13356 tablet_bootstrap.cc:654] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:19.874243 13356 tablet_bootstrap.cc:492] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd: No bootstrap required, opened a new log
I20260619 06:38:19.874390 13356 ts_tablet_manager.cc:1397] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s
I20260619 06:38:19.874972 13356 raft_consensus.cc:348] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:19.875156 13356 raft_consensus.cc:374] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:19.875273 13356 raft_consensus.cc:729] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 966ce41aae8a49d0933280cc4633f6dd, State: Initialized, Role: FOLLOWER
I20260619 06:38:19.875541 13356 consensus_queue.cc:260] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:19.876648 13356 ts_tablet_manager.cc:1428] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260619 06:38:20.027933 13373 raft_consensus.cc:482] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:38:20.028136 13373 raft_consensus.cc:504] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:20.029023 13373 leader_election.cc:288] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 966ce41aae8a49d0933280cc4633f6dd (127.10.192.66:42805), 638cc9bb76fa4f3f81669bf8f58996ac (127.10.192.67:38705)
I20260619 06:38:20.029597 13206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e423d7b27ee487991f7d54c3c6a3535" candidate_uuid: "504427d18ad64c629a25b5e936dc80e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" is_pre_election: true
I20260619 06:38:20.029608 13067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e423d7b27ee487991f7d54c3c6a3535" candidate_uuid: "504427d18ad64c629a25b5e936dc80e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "966ce41aae8a49d0933280cc4633f6dd" is_pre_election: true
I20260619 06:38:20.029841 13206 raft_consensus.cc:2454] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 504427d18ad64c629a25b5e936dc80e1 in term 0.
I20260619 06:38:20.029920 13067 raft_consensus.cc:2454] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 504427d18ad64c629a25b5e936dc80e1 in term 0.
I20260619 06:38:20.030401 12854 leader_election.cc:302] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504427d18ad64c629a25b5e936dc80e1, 638cc9bb76fa4f3f81669bf8f58996ac; no voters:
I20260619 06:38:20.030714 13373 raft_consensus.cc:2781] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:38:20.030848 13373 raft_consensus.cc:482] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:38:20.030980 13373 raft_consensus.cc:3037] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:20.033797 13373 raft_consensus.cc:504] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:20.034570 13373 leader_election.cc:288] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [CANDIDATE]: Term 1 election: Requested vote from peers 966ce41aae8a49d0933280cc4633f6dd (127.10.192.66:42805), 638cc9bb76fa4f3f81669bf8f58996ac (127.10.192.67:38705)
I20260619 06:38:20.035315 13206 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e423d7b27ee487991f7d54c3c6a3535" candidate_uuid: "504427d18ad64c629a25b5e936dc80e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "638cc9bb76fa4f3f81669bf8f58996ac"
I20260619 06:38:20.035356 13067 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0e423d7b27ee487991f7d54c3c6a3535" candidate_uuid: "504427d18ad64c629a25b5e936dc80e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "966ce41aae8a49d0933280cc4633f6dd"
I20260619 06:38:20.035596 13206 raft_consensus.cc:3037] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:20.035684 13067 raft_consensus.cc:3037] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:20.037652 13206 raft_consensus.cc:2454] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 504427d18ad64c629a25b5e936dc80e1 in term 1.
I20260619 06:38:20.039363 13067 raft_consensus.cc:2454] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 504427d18ad64c629a25b5e936dc80e1 in term 1.
I20260619 06:38:20.039842 12854 leader_election.cc:302] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 504427d18ad64c629a25b5e936dc80e1, 638cc9bb76fa4f3f81669bf8f58996ac; no voters:
I20260619 06:38:20.040197 13373 raft_consensus.cc:2781] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:20.040421 13373 raft_consensus.cc:686] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [term 1 LEADER]: Becoming Leader. State: Replica: 504427d18ad64c629a25b5e936dc80e1, State: Running, Role: LEADER
I20260619 06:38:20.040723 13373 consensus_queue.cc:237] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } }
I20260619 06:38:20.043745 12766 catalog_manager.cc:5495] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 504427d18ad64c629a25b5e936dc80e1 (127.10.192.65). New cstate: current_term: 1 leader_uuid: "504427d18ad64c629a25b5e936dc80e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "504427d18ad64c629a25b5e936dc80e1" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42813 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 } health_report { overall_health: UNKNOWN } } }
I20260619 06:38:20.083858 13206 raft_consensus.cc:1261] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac [term 1 FOLLOWER]: Refusing update from remote peer 504427d18ad64c629a25b5e936dc80e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:20.083978 13067 raft_consensus.cc:1261] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd [term 1 FOLLOWER]: Refusing update from remote peer 504427d18ad64c629a25b5e936dc80e1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:20.084573 13373 consensus_queue.cc:1035] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "638cc9bb76fa4f3f81669bf8f58996ac" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:20.084882 13377 consensus_queue.cc:1035] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "966ce41aae8a49d0933280cc4633f6dd" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 06:38:20.115417 13329 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260619 06:38:21.704706 12765 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:38:21.704955 12765 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:47278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:38:21.709208 12765 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9c1d8a55754d4f7eae925c0f691d3de5: Sending DeleteTablet for 3 replicas of tablet 0e423d7b27ee487991f7d54c3c6a3535
I20260619 06:38:21.710161 12903 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e423d7b27ee487991f7d54c3c6a3535 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:21 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:41160
I20260619 06:38:21.710193 13181 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e423d7b27ee487991f7d54c3c6a3535 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:21 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:41746
I20260619 06:38:21.710281 13041 tablet_service.cc:1514] Processing DeleteTablet for tablet 0e423d7b27ee487991f7d54c3c6a3535 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:21 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:53838
I20260619 06:38:21.712034 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 12837
I20260619 06:38:21.724109 13406 tablet_replica.cc:330] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1: stopping tablet replica
I20260619 06:38:21.724606 13406 raft_consensus.cc:2229] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:38:21.725273 13406 raft_consensus.cc:2258] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:21.726024 13407 tablet_replica.cc:330] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd: stopping tablet replica
I20260619 06:38:21.726631 13405 tablet_replica.cc:330] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac: stopping tablet replica
I20260619 06:38:21.726850 13405 raft_consensus.cc:2229] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:21.726922 13406 ts_tablet_manager.cc:1905] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:21.727133 13405 raft_consensus.cc:2258] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:21.727522 13407 raft_consensus.cc:2229] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:21.728112 13407 raft_consensus.cc:2258] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:21.728591 13405 ts_tablet_manager.cc:1905] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:21.729195 13407 ts_tablet_manager.cc:1905] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd: Deleting tablet data with delete state TABLET_DATA_DELETED
Jun 19 06:38:21 dist-test-slave-7lz4 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851099, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:38:21.734071 13406 ts_tablet_manager.cc:1918] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260619 06:38:21.734335 13406 log.cc:1196] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/0e423d7b27ee487991f7d54c3c6a3535
I20260619 06:38:21.735006 13406 ts_tablet_manager.cc:1939] T 0e423d7b27ee487991f7d54c3c6a3535 P 504427d18ad64c629a25b5e936dc80e1: Deleting consensus metadata
I20260619 06:38:21.735554 13405 ts_tablet_manager.cc:1918] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260619 06:38:21.735781 13405 log.cc:1196] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/0e423d7b27ee487991f7d54c3c6a3535
I20260619 06:38:21.736328 13405 ts_tablet_manager.cc:1939] T 0e423d7b27ee487991f7d54c3c6a3535 P 638cc9bb76fa4f3f81669bf8f58996ac: Deleting consensus metadata
I20260619 06:38:21.736332 12752 catalog_manager.cc:4841] TS 504427d18ad64c629a25b5e936dc80e1 (127.10.192.65:42813): tablet 0e423d7b27ee487991f7d54c3c6a3535 (table test-table [id=d92f982368c34ab8bf48685767538e6d]) successfully deleted
I20260619 06:38:21.736543 13407 ts_tablet_manager.cc:1918] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260619 06:38:21.736774 13407 log.cc:1196] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/0e423d7b27ee487991f7d54c3c6a3535
I20260619 06:38:21.737228 13407 ts_tablet_manager.cc:1939] T 0e423d7b27ee487991f7d54c3c6a3535 P 966ce41aae8a49d0933280cc4633f6dd: Deleting consensus metadata
I20260619 06:38:21.737488 12751 catalog_manager.cc:4841] TS 638cc9bb76fa4f3f81669bf8f58996ac (127.10.192.67:38705): tablet 0e423d7b27ee487991f7d54c3c6a3535 (table test-table [id=d92f982368c34ab8bf48685767538e6d]) successfully deleted
I20260619 06:38:21.738417 12752 catalog_manager.cc:4841] TS 966ce41aae8a49d0933280cc4633f6dd (127.10.192.66:42805): tablet 0e423d7b27ee487991f7d54c3c6a3535 (table test-table [id=d92f982368c34ab8bf48685767538e6d]) successfully deleted
I20260619 06:38:21.738906 13409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:21.713349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41166 (local address 127.10.192.65:42813)
0619 06:38:21.716167 (+ 2818us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:21.716176 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:21.716208 (+ 32us) server_negotiation.cc:407] Connection header received
0619 06:38:21.716294 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:21.716302 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:21.716408 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:21.718885 (+ 2477us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:21.719146 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:21.720724 (+ 1578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:21.723393 (+ 2669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:21.724380 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:21.725945 (+ 1565us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:21.730900 (+ 4955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:21.730925 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:21.730948 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:21.730997 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:21.735345 (+ 4348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:21.736387 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:21.736399 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:21.736402 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:21.736571 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:21.737076 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:21.737081 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:21.737084 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:21.737572 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:21.737859 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:21.738305 (+ 446us) server_negotiation.cc:299] Negotiation successful
0619 06:38:21.738546 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2612,"thread_start_us":2490,"threads_started":1}
W20260619 06:38:21.739621 12968 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41166
W20260619 06:38:21.740324 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 12837: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:38:21.740520 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 12837
I20260619 06:38:21.763896 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 12977
Jun 19 06:38:21 dist-test-slave-7lz4 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851099, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.192.66@KRBTEST.COM
I20260619 06:38:21.779408 13410 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:21.764876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53874 (local address 127.10.192.66:42805)
0619 06:38:21.765445 (+ 569us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:21.765449 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:21.765465 (+ 16us) server_negotiation.cc:407] Connection header received
0619 06:38:21.765519 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:21.765523 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:21.765584 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:21.765680 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:21.766919 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:21.767748 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:21.768963 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:21.769413 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:21.769514 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:21.773682 (+ 4168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:21.773697 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:21.773713 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:21.773754 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:21.776607 (+ 2853us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:21.777342 (+ 735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:21.777349 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:21.777352 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:21.777501 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:21.777881 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:21.777884 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:21.777886 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:21.778260 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:21.778481 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:21.778825 (+ 344us) server_negotiation.cc:299] Negotiation successful
0619 06:38:21.779003 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":283,"threads_started":1}
W20260619 06:38:21.780486 13107 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53874
W20260619 06:38:21.781118 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 12977: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:38:21.781277 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 12977
I20260619 06:38:21.806345 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 13116
Jun 19 06:38:21 dist-test-slave-7lz4 krb5kdc[12721](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851099, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.10.192.67@KRBTEST.COM
I20260619 06:38:21.828907 13411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:21.807122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41748 (local address 127.10.192.67:38705)
0619 06:38:21.807711 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:21.807716 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:21.807732 (+ 16us) server_negotiation.cc:407] Connection header received
0619 06:38:21.807784 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:21.807788 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:21.807852 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:21.807945 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:21.809199 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:21.809952 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:21.811191 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:21.811587 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:21.811823 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:21.822819 (+ 10996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:21.822837 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:21.822854 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:21.822896 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:21.825972 (+ 3076us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:21.826759 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:21.826767 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:21.826770 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:21.826915 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:21.827255 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:21.827259 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:21.827261 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:21.827607 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:21.827912 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:21.828292 (+ 380us) server_negotiation.cc:299] Negotiation successful
0619 06:38:21.828490 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":426,"thread_start_us":278,"threads_started":1}
W20260619 06:38:21.829640 13246 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41748
W20260619 06:38:21.830260 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 13116: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:38:21.830430 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 13116
I20260619 06:38:21.848587 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 12734
I20260619 06:38:21.849804 12806 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:21.966434 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 12734
2026-06-19T06:38:21Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (8505 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:38:22 dist-test-slave-7lz4 krb5kdc[13415](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:38:22 dist-test-slave-7lz4 krb5kdc[13415](info): set up 2 sockets
Jun 19 06:38:22 dist-test-slave-7lz4 krb5kdc[13415](info): commencing operation
krb5kdc: starting...
W20260619 06:38:23.072202 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.061s user 0.000s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:38:23 dist-test-slave-7lz4 krb5kdc[13415](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851103, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:38:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:38:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:38:23.272055 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:36471
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:46047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:36471
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:23.597671 13428 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:23.598084 13428 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:23.598273 13428 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:23.606313 13428 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:38:23.606487 13428 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:23.606571 13428 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:23.606683 13428 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:38:23.606750 13428 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:38:23.616925 13428 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:46047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:36471
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:36471
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:23.618412 13428 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:23.619833 13428 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:23.632220 13433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:23.632283 13436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:23.632304 13434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:23.633625 13428 server_base.cc:1034] running on GCE node
I20260619 06:38:23.634461 13428 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:23.636053 13428 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:23.637302 13428 hybrid_clock.cc:648] HybridClock initialized: now 1781851103637245 us; error 57 us; skew 500 ppm
I20260619 06:38:23.637657 13428 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:23 dist-test-slave-7lz4 krb5kdc[13415](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851103, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:23.640862 13428 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:38:23.642500 13428 webserver.cc:460] Webserver started at http://127.10.192.126:38735/ using document root <none> and password file <none>
I20260619 06:38:23.643265 13428 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:23.643412 13428 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:23.643818 13428 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:23.646849 13428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "0d9ef69490ac468ea5cff9e1813592ba"
format_stamp: "Formatted at 2026-06-19 06:38:23 on dist-test-slave-7lz4"
server_key: "6ce484d592d356e41805a04c58c282fb"
server_key_iv: "9ed4195321792fb85be7adbeb83f6852"
server_key_version: "encryptionkey@0"
I20260619 06:38:23.647733 13428 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "0d9ef69490ac468ea5cff9e1813592ba"
format_stamp: "Formatted at 2026-06-19 06:38:23 on dist-test-slave-7lz4"
server_key: "6ce484d592d356e41805a04c58c282fb"
server_key_iv: "9ed4195321792fb85be7adbeb83f6852"
server_key_version: "encryptionkey@0"
I20260619 06:38:23.653333 13428 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260619 06:38:23.657243 13443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:23.658818 13428 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.001s
I20260619 06:38:23.659045 13428 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "0d9ef69490ac468ea5cff9e1813592ba"
format_stamp: "Formatted at 2026-06-19 06:38:23 on dist-test-slave-7lz4"
server_key: "6ce484d592d356e41805a04c58c282fb"
server_key_iv: "9ed4195321792fb85be7adbeb83f6852"
server_key_version: "encryptionkey@0"
I20260619 06:38:23.659272 13428 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:23.672003 13428 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:23.676189 13428 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:23.676432 13428 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:23.694924 13428 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:36471
I20260619 06:38:23.694944 13494 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:36471 every 8 connection(s)
I20260619 06:38:23.696460 13428 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:38:23.700472 13495 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:23.700572 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 13428
I20260619 06:38:23.700848 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:38:23.701527 11009 external_mini_cluster.cc:1428] Setting key 46ceaeffb8f97cce322f8a6672e8a8d1
I20260619 06:38:23.714782 13495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba: Bootstrap starting.
Jun 19 06:38:23 dist-test-slave-7lz4 krb5kdc[13415](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851103, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:23.718816 13495 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:23.720024 13495 log.cc:824] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:23.723470 13495 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba: No bootstrap required, opened a new log
I20260619 06:38:23.726936 13498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:23.703498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33254 (local address 127.10.192.126:36471)
0619 06:38:23.704389 (+ 891us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:23.704401 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:23.704444 (+ 43us) server_negotiation.cc:407] Connection header received
0619 06:38:23.706669 (+ 2225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:23.706697 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:23.707131 (+ 434us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:23.707496 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:23.709382 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:23.710745 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:23.712669 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:23.713367 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:23.713508 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:23.718052 (+ 4544us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:23.718064 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:23.718085 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:23.718137 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:23.721983 (+ 3846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:23.722715 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:23.722723 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:23.722732 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:23.722956 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:23.723423 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:23.723430 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:23.723436 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:23.724243 (+ 807us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:23.724570 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:23.725006 (+ 436us) server_negotiation.cc:299] Negotiation successful
0619 06:38:23.725469 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":677,"thread_start_us":460,"threads_started":1}
I20260619 06:38:23.732511 13495 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d9ef69490ac468ea5cff9e1813592ba" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 36471 } }
I20260619 06:38:23.732892 13495 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:23.733021 13495 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d9ef69490ac468ea5cff9e1813592ba, State: Initialized, Role: FOLLOWER
I20260619 06:38:23.733595 13495 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d9ef69490ac468ea5cff9e1813592ba" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 36471 } }
I20260619 06:38:23.733855 13495 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:38:23.733987 13495 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:38:23.734157 13495 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:23.736380 13495 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d9ef69490ac468ea5cff9e1813592ba" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 36471 } }
I20260619 06:38:23.736894 13495 leader_election.cc:302] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0d9ef69490ac468ea5cff9e1813592ba; no voters:
I20260619 06:38:23.737557 13495 leader_election.cc:288] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:38:23.737685 13500 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:23.738907 13500 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba [term 1 LEADER]: Becoming Leader. State: Replica: 0d9ef69490ac468ea5cff9e1813592ba, State: Running, Role: LEADER
I20260619 06:38:23.739491 13500 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d9ef69490ac468ea5cff9e1813592ba" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 36471 } }
I20260619 06:38:23.740026 13495 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:38:23.742566 13502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d9ef69490ac468ea5cff9e1813592ba. Latest consensus state: current_term: 1 leader_uuid: "0d9ef69490ac468ea5cff9e1813592ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d9ef69490ac468ea5cff9e1813592ba" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 36471 } } }
I20260619 06:38:23.742662 13501 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0d9ef69490ac468ea5cff9e1813592ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d9ef69490ac468ea5cff9e1813592ba" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 36471 } } }
I20260619 06:38:23.742944 13502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:23.742985 13501 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:23.745491 13507 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:38:23.750527 13507 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:38:23.759953 13507 catalog_manager.cc:1347] Generated new cluster ID: 5624dd5e0ebc4eefaf69f359f70ad4d9
I20260619 06:38:23.760092 13507 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:38:23.782838 13507 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:38:23.784365 13507 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:38:23.796039 13507 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0d9ef69490ac468ea5cff9e1813592ba: Generated new TSK 0
I20260619 06:38:23.797075 13507 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
I20260619 06:38:23.845808 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:36471
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:46047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:24.189674 13521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:24.190054 13521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:24.190241 13521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:24.197825 13521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:24.198038 13521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:24.198239 13521 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:38:24.208532 13521 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:46047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:36471
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:24.210012 13521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:24.211472 13521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:24.225446 13527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:24.225415 13526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:24.225972 13529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:24.226672 13521 server_base.cc:1034] running on GCE node
I20260619 06:38:24.227406 13521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:24.228514 13521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:24.229763 13521 hybrid_clock.cc:648] HybridClock initialized: now 1781851104229728 us; error 69 us; skew 500 ppm
I20260619 06:38:24.230115 13521 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:24 dist-test-slave-7lz4 krb5kdc[13415](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851104, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:24.233625 13521 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:38:24.235308 13521 webserver.cc:460] Webserver started at http://127.10.192.65:34165/ using document root <none> and password file <none>
I20260619 06:38:24.236195 13521 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:24.236344 13521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:24.236663 13521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:24.239737 13521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "7ddfd72314b64e9ab82a46b9b978a9f1"
format_stamp: "Formatted at 2026-06-19 06:38:24 on dist-test-slave-7lz4"
server_key: "c92367e2c5b47f1b516eda5222478226"
server_key_iv: "6b620dbb9ac6369c8cd834b2f7117189"
server_key_version: "encryptionkey@0"
I20260619 06:38:24.240631 13521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "7ddfd72314b64e9ab82a46b9b978a9f1"
format_stamp: "Formatted at 2026-06-19 06:38:24 on dist-test-slave-7lz4"
server_key: "c92367e2c5b47f1b516eda5222478226"
server_key_iv: "6b620dbb9ac6369c8cd834b2f7117189"
server_key_version: "encryptionkey@0"
I20260619 06:38:24.246763 13521 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260619 06:38:24.250566 13536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:24.252072 13521 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:38:24.252257 13521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "7ddfd72314b64e9ab82a46b9b978a9f1"
format_stamp: "Formatted at 2026-06-19 06:38:24 on dist-test-slave-7lz4"
server_key: "c92367e2c5b47f1b516eda5222478226"
server_key_iv: "6b620dbb9ac6369c8cd834b2f7117189"
server_key_version: "encryptionkey@0"
I20260619 06:38:24.252481 13521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:24.274909 13521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:24.279506 13521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:24.279875 13521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:24.280978 13521 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:24.282392 13521 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:24.282505 13521 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:24.282665 13521 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:24.282738 13521 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:24.317402 13521 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:43615
I20260619 06:38:24.317477 13648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:43615 every 8 connection(s)
I20260619 06:38:24.318854 13521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:38:24.328238 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 13521
I20260619 06:38:24.328598 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:38:24.329532 11009 external_mini_cluster.cc:1428] Setting key e3094dc8ef9e55317b44f078086da80c
Jun 19 06:38:24 dist-test-slave-7lz4 krb5kdc[13415](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851104, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:24.342093 13651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:24.321651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:57555 (local address 127.10.192.126:36471)
0619 06:38:24.322130 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:24.322137 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:24.323237 (+ 1100us) server_negotiation.cc:407] Connection header received
0619 06:38:24.325150 (+ 1913us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:24.325155 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:24.325226 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:24.325327 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:24.326876 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:24.327598 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:24.330362 (+ 2764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:24.330931 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:24.331070 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:24.335703 (+ 4633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:24.335709 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:24.335713 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:24.335748 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:24.338583 (+ 2835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:24.339297 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:24.339305 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:24.339312 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:24.339463 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:24.339941 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:24.339950 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:24.339957 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:24.340348 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:24.340501 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:24.341326 (+ 825us) server_negotiation.cc:299] Negotiation successful
0619 06:38:24.341595 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":339,"thread_start_us":221,"threads_started":1}
I20260619 06:38:24.342764 13652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:24.322306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:36471 (local address 127.10.192.65:57555)
0619 06:38:24.323058 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:24.323098 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:24.324861 (+ 1763us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:24.325562 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:24.325570 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:24.326116 (+ 546us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:24.326697 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:24.326715 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:24.327821 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:24.327827 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:24.330184 (+ 2357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:24.330206 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:24.331162 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:24.331168 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:24.331472 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:24.332255 (+ 783us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:24.332297 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:24.335380 (+ 3083us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:24.338722 (+ 3342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:24.338730 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:24.338745 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:24.339176 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:24.339570 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:24.339573 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:24.339576 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:24.339835 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:24.340491 (+ 656us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:24.340497 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:24.340894 (+ 397us) client_negotiation.cc:769] Sending connection context
0619 06:38:24.341189 (+ 295us) client_negotiation.cc:240] Negotiation successful
0619 06:38:24.341609 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":294,"threads_started":1}
I20260619 06:38:24.344434 13649 heartbeater.cc:347] Connected to a master server at 127.10.192.126:36471
I20260619 06:38:24.344782 13649 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:24.345693 13649 heartbeater.cc:511] Master 127.10.192.126:36471 requested a full tablet report, sending...
I20260619 06:38:24.347962 13460 ts_manager.cc:194] Registered new tserver with Master: 7ddfd72314b64e9ab82a46b9b978a9f1 (127.10.192.65:43615)
WARNING: no policy specified for kudu/127.10.192.66@KRBTEST.COM; defaulting to no policy
I20260619 06:38:24.349493 13460 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:57555
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
I20260619 06:38:24.375519 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:36471
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:46047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:24.719180 13655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:24.719481 13655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:24.719578 13655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:24.728129 13655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:24.728247 13655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:24.728363 13655 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:38:24.738451 13655 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:46047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:36471
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:24.739791 13655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:24.741175 13655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:24.754628 13660 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:24.754588 13663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:24.754674 13661 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:24.756104 13655 server_base.cc:1034] running on GCE node
I20260619 06:38:24.756695 13655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:24.757741 13655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:24.758965 13655 hybrid_clock.cc:648] HybridClock initialized: now 1781851104758894 us; error 62 us; skew 500 ppm
I20260619 06:38:24.759289 13655 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:24 dist-test-slave-7lz4 krb5kdc[13415](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851104, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:24.762424 13655 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:38:24.764009 13655 webserver.cc:460] Webserver started at http://127.10.192.66:34267/ using document root <none> and password file <none>
I20260619 06:38:24.764712 13655 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:24.764848 13655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:24.765151 13655 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:24.768136 13655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "620e937d77a540e8b5b633afb8e1973e"
format_stamp: "Formatted at 2026-06-19 06:38:24 on dist-test-slave-7lz4"
server_key: "4b8387f701919066cca7980a47d0a208"
server_key_iv: "ec88d030a59753c8568717fd1af04f1a"
server_key_version: "encryptionkey@0"
I20260619 06:38:24.768957 13655 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "620e937d77a540e8b5b633afb8e1973e"
format_stamp: "Formatted at 2026-06-19 06:38:24 on dist-test-slave-7lz4"
server_key: "4b8387f701919066cca7980a47d0a208"
server_key_iv: "ec88d030a59753c8568717fd1af04f1a"
server_key_version: "encryptionkey@0"
I20260619 06:38:24.775192 13655 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260619 06:38:24.778846 13670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:24.780366 13655 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:38:24.780552 13655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "620e937d77a540e8b5b633afb8e1973e"
format_stamp: "Formatted at 2026-06-19 06:38:24 on dist-test-slave-7lz4"
server_key: "4b8387f701919066cca7980a47d0a208"
server_key_iv: "ec88d030a59753c8568717fd1af04f1a"
server_key_version: "encryptionkey@0"
I20260619 06:38:24.780777 13655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:24.797933 13655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:24.802487 13655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:24.802806 13655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:24.803892 13655 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:24.805291 13655 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:24.805394 13655 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:24.805542 13655 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:24.805609 13655 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:24.838164 13655 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:44407
I20260619 06:38:24.838210 13782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:44407 every 8 connection(s)
I20260619 06:38:24.839519 13655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:38:24.845655 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 13655
I20260619 06:38:24.845860 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:38:24.846439 11009 external_mini_cluster.cc:1428] Setting key 61a9addd2bbbba4ce68db2206dfa8822
Jun 19 06:38:24 dist-test-slave-7lz4 krb5kdc[13415](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851104, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:24.864207 13651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:24.842451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:35967 (local address 127.10.192.126:36471)
0619 06:38:24.842629 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:24.842634 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:24.844051 (+ 1417us) server_negotiation.cc:407] Connection header received
0619 06:38:24.846434 (+ 2383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:24.846439 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:24.846545 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:24.846651 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:24.848645 (+ 1994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:24.849334 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:24.851985 (+ 2651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:24.852439 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:24.852569 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:24.856729 (+ 4160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:24.856738 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:24.856746 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:24.856794 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:24.860459 (+ 3665us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:24.861217 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:24.861226 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:24.861232 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:24.861401 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:24.862045 (+ 644us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:24.862053 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:24.862058 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:24.862479 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:24.862678 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:24.863614 (+ 936us) server_negotiation.cc:299] Negotiation successful
0619 06:38:24.863946 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260619 06:38:24.865804 13785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:24.843020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:36471 (local address 127.10.192.66:35967)
0619 06:38:24.843889 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:24.843936 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:24.846108 (+ 2172us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:24.846943 (+ 835us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:24.846956 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:24.847727 (+ 771us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:24.848469 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:24.848495 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:24.849496 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:24.849505 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:24.851803 (+ 2298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:24.851822 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:24.852698 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:24.852707 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:24.853048 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:24.853843 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:24.853878 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:24.856456 (+ 2578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:24.860605 (+ 4149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:24.860612 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:24.860628 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:24.861074 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:24.861572 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:24.861580 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:24.861586 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:24.861858 (+ 272us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:24.862620 (+ 762us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:24.862631 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:24.863187 (+ 556us) client_negotiation.cc:769] Sending connection context
0619 06:38:24.863545 (+ 358us) client_negotiation.cc:240] Negotiation successful
0619 06:38:24.864240 (+ 695us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":366,"threads_started":1}
WARNING: no policy specified for kudu/127.10.192.67@KRBTEST.COM; defaulting to no policy
I20260619 06:38:24.867486 13783 heartbeater.cc:347] Connected to a master server at 127.10.192.126:36471
I20260619 06:38:24.867875 13783 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:24.868593 13783 heartbeater.cc:511] Master 127.10.192.126:36471 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.67@KRBTEST.COM" created.
I20260619 06:38:24.870208 13460 ts_manager.cc:194] Registered new tserver with Master: 620e937d77a540e8b5b633afb8e1973e (127.10.192.66:44407)
I20260619 06:38:24.871074 13460 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:35967
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
I20260619 06:38:24.892619 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:36471
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:46047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:25.223104 13788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:25.223405 13788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:25.223582 13788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:25.231233 13788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:25.231362 13788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:25.231479 13788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:38:25.241636 13788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:46047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:36471
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:25.242914 13788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:25.244254 13788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:25.258150 13793 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:25.258104 13796 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:25.258075 13794 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:25.264209 13788 server_base.cc:1034] running on GCE node
I20260619 06:38:25.264988 13788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:25.266067 13788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:25.267274 13788 hybrid_clock.cc:648] HybridClock initialized: now 1781851105267211 us; error 58 us; skew 500 ppm
I20260619 06:38:25.267675 13788 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:25 dist-test-slave-7lz4 krb5kdc[13415](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851105, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:25.270947 13788 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:38:25.272627 13788 webserver.cc:460] Webserver started at http://127.10.192.67:34519/ using document root <none> and password file <none>
I20260619 06:38:25.273386 13788 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:25.273528 13788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:25.273851 13788 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:25.276932 13788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "f0e34d64dcc64f27a2e324e6ddde9323"
format_stamp: "Formatted at 2026-06-19 06:38:25 on dist-test-slave-7lz4"
server_key: "ec4830de5481cf0414c8267c7b7491b9"
server_key_iv: "e9550193a248260cb3dd6a7184a53458"
server_key_version: "encryptionkey@0"
I20260619 06:38:25.277797 13788 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "f0e34d64dcc64f27a2e324e6ddde9323"
format_stamp: "Formatted at 2026-06-19 06:38:25 on dist-test-slave-7lz4"
server_key: "ec4830de5481cf0414c8267c7b7491b9"
server_key_iv: "e9550193a248260cb3dd6a7184a53458"
server_key_version: "encryptionkey@0"
I20260619 06:38:25.283416 13788 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260619 06:38:25.287531 13803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:25.289157 13788 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:38:25.289368 13788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "f0e34d64dcc64f27a2e324e6ddde9323"
format_stamp: "Formatted at 2026-06-19 06:38:25 on dist-test-slave-7lz4"
server_key: "ec4830de5481cf0414c8267c7b7491b9"
server_key_iv: "e9550193a248260cb3dd6a7184a53458"
server_key_version: "encryptionkey@0"
I20260619 06:38:25.289594 13788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:25.310907 13788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:25.315388 13788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:25.315768 13788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:25.316912 13788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:25.318361 13788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:25.318466 13788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:25.318619 13788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:25.318684 13788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:25.352830 13649 heartbeater.cc:503] Master 127.10.192.126:36471 was elected leader, sending a full tablet report...
I20260619 06:38:25.353441 13788 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:38439
I20260619 06:38:25.353464 13915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:38439 every 8 connection(s)
I20260619 06:38:25.354866 13788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:38:25.361872 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 13788
I20260619 06:38:25.362097 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:38:25.362573 11009 external_mini_cluster.cc:1428] Setting key c6621af47eabe52e3ee20c56515ebb93
Jun 19 06:38:25 dist-test-slave-7lz4 krb5kdc[13415](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851105, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:25.374751 13651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:25.357451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:53325 (local address 127.10.192.126:36471)
0619 06:38:25.357635 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:25.357639 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:25.358898 (+ 1259us) server_negotiation.cc:407] Connection header received
0619 06:38:25.360852 (+ 1954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:25.360857 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:25.360946 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:25.361057 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:25.362709 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:25.363564 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:25.365256 (+ 1692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:25.365646 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:25.365776 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:25.369213 (+ 3437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:25.369218 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:25.369222 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:25.369253 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:25.371776 (+ 2523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:25.372467 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:25.372475 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:25.372478 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:25.372606 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:25.373014 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:25.373021 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:25.373025 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:25.373290 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:25.373448 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:25.374150 (+ 702us) server_negotiation.cc:299] Negotiation successful
0619 06:38:25.374380 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260619 06:38:25.375777 13918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:25.357964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:36471 (local address 127.10.192.67:53325)
0619 06:38:25.358717 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:25.358755 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:25.360568 (+ 1813us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:25.361291 (+ 723us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:25.361300 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:25.361837 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:25.362505 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:25.362523 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:25.363729 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:25.363739 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:25.365117 (+ 1378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:25.365128 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:25.365864 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:25.365883 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:25.366108 (+ 225us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:25.366772 (+ 664us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:25.366799 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:25.368998 (+ 2199us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:25.371912 (+ 2914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:25.371921 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:25.371940 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:25.372349 (+ 409us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:25.372711 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:25.372717 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:25.372721 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:25.372910 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:25.373430 (+ 520us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:25.373437 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:25.373776 (+ 339us) client_negotiation.cc:769] Sending connection context
0619 06:38:25.374062 (+ 286us) client_negotiation.cc:240] Negotiation successful
0619 06:38:25.374612 (+ 550us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":295,"threads_started":1}
I20260619 06:38:25.377147 13916 heartbeater.cc:347] Connected to a master server at 127.10.192.126:36471
I20260619 06:38:25.377496 13916 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:25.378218 13916 heartbeater.cc:511] Master 127.10.192.126:36471 requested a full tablet report, sending...
I20260619 06:38:25.379698 13460 ts_manager.cc:194] Registered new tserver with Master: f0e34d64dcc64f27a2e324e6ddde9323 (127.10.192.67:38439)
I20260619 06:38:25.380532 13460 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:53325
I20260619 06:38:25.390271 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260619 06:38:25.420369 13651 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:38:25.417764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46972 (local address 127.10.192.126:36471)
0619 06:38:25.417986 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:25.417993 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:25.418375 (+ 382us) server_negotiation.cc:407] Connection header received
0619 06:38:25.418583 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:25.418588 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:25.418652 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:25.418757 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:25.420167 (+ 1410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46972: BlockingRecv error: recv got EOF from 127.0.0.1:46972 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260619 06:38:25.423514 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 13521
W20260619 06:38:25.426366 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 13521: Not authorized: Client connection negotiation failed: client connection to 127.10.192.65:43615: server requires authentication, but client does not have Kerberos credentials available
I20260619 06:38:25.426548 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 13521
I20260619 06:38:25.441999 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 13655
W20260619 06:38:25.444765 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 13655: Not authorized: Client connection negotiation failed: client connection to 127.10.192.66:44407: server requires authentication, but client does not have Kerberos credentials available
I20260619 06:38:25.444962 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 13655
I20260619 06:38:25.460336 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 13788
W20260619 06:38:25.463287 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 13788: Not authorized: Client connection negotiation failed: client connection to 127.10.192.67:38439: server requires authentication, but client does not have Kerberos credentials available
I20260619 06:38:25.463491 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 13788
I20260619 06:38:25.478543 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 13428
I20260619 06:38:25.479874 13490 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:25.582734 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 13428
2026-06-19T06:38:25Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (3613 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:38:25 dist-test-slave-7lz4 krb5kdc[13933](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:38:25 dist-test-slave-7lz4 krb5kdc[13933](info): set up 2 sockets
Jun 19 06:38:25 dist-test-slave-7lz4 krb5kdc[13933](info): commencing operation
krb5kdc: starting...
W20260619 06:38:26.672072 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.047s user 0.000s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:38:26 dist-test-slave-7lz4 krb5kdc[13933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:38:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:38:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:38:26.875087 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:37641
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:42095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:37641
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:27.207226 13946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:27.207557 13946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:27.207680 13946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:27.215114 13946 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:38:27.215243 13946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:27.215291 13946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:27.215346 13946 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:38:27.215395 13946 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:38:27.226006 13946 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:42095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:37641
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:37641
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:27.227322 13946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:27.228677 13946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:27.240957 13951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:27.240887 13954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:27.240932 13952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:27.241912 13946 server_base.cc:1034] running on GCE node
I20260619 06:38:27.242837 13946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:27.244541 13946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:27.245808 13946 hybrid_clock.cc:648] HybridClock initialized: now 1781851107245749 us; error 77 us; skew 500 ppm
I20260619 06:38:27.246215 13946 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:27 dist-test-slave-7lz4 krb5kdc[13933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851107, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:27.252591 13946 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:38:27.254237 13946 webserver.cc:460] Webserver started at http://127.10.192.126:34985/ using document root <none> and password file <none>
I20260619 06:38:27.254976 13946 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:27.255118 13946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:27.255436 13946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:27.258554 13946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "ee3b3d096cc749f794a341a1b608d5e0"
format_stamp: "Formatted at 2026-06-19 06:38:27 on dist-test-slave-7lz4"
server_key: "9d4d46bb2d3f11e6b30a8941cc0cdc5f"
server_key_iv: "fae3bd3be67a9aff777eaed65ac31db3"
server_key_version: "encryptionkey@0"
I20260619 06:38:27.259433 13946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "ee3b3d096cc749f794a341a1b608d5e0"
format_stamp: "Formatted at 2026-06-19 06:38:27 on dist-test-slave-7lz4"
server_key: "9d4d46bb2d3f11e6b30a8941cc0cdc5f"
server_key_iv: "fae3bd3be67a9aff777eaed65ac31db3"
server_key_version: "encryptionkey@0"
I20260619 06:38:27.265897 13946 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260619 06:38:27.270037 13961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:27.271536 13946 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 06:38:27.271770 13946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "ee3b3d096cc749f794a341a1b608d5e0"
format_stamp: "Formatted at 2026-06-19 06:38:27 on dist-test-slave-7lz4"
server_key: "9d4d46bb2d3f11e6b30a8941cc0cdc5f"
server_key_iv: "fae3bd3be67a9aff777eaed65ac31db3"
server_key_version: "encryptionkey@0"
I20260619 06:38:27.271996 13946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:27.301154 13946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:27.305627 13946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:27.305931 13946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:27.325122 13946 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:37641
I20260619 06:38:27.325073 14012 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:37641 every 8 connection(s)
I20260619 06:38:27.326611 13946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:38:27.330503 14013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:27.334792 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 13946
I20260619 06:38:27.335052 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:38:27.335742 11009 external_mini_cluster.cc:1428] Setting key b7676c9107153bcc9920a36be626f675
I20260619 06:38:27.342372 14013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0: Bootstrap starting.
I20260619 06:38:27.346170 14013 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:27.347342 14013 log.cc:824] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:27.350526 14013 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0: No bootstrap required, opened a new log
Jun 19 06:38:27 dist-test-slave-7lz4 krb5kdc[13933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:27.361546 14016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:27.337758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47586 (local address 127.10.192.126:37641)
0619 06:38:27.338662 (+ 904us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:27.338675 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:27.338719 (+ 44us) server_negotiation.cc:407] Connection header received
0619 06:38:27.340701 (+ 1982us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:27.340727 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:27.341169 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:27.341527 (+ 358us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:27.343457 (+ 1930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:27.344841 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:27.346649 (+ 1808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:27.347384 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:27.347624 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:27.352145 (+ 4521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:27.352158 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:27.352181 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:27.352236 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:27.356476 (+ 4240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:27.357249 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:27.357264 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:27.357274 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:27.357509 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:27.357877 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:27.357882 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:27.357885 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:27.358752 (+ 867us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:27.359042 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:27.359448 (+ 406us) server_negotiation.cc:299] Negotiation successful
0619 06:38:27.360006 (+ 558us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":656,"thread_start_us":413,"threads_started":1}
I20260619 06:38:27.362053 14013 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee3b3d096cc749f794a341a1b608d5e0" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37641 } }
I20260619 06:38:27.362453 14013 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:27.362569 14013 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee3b3d096cc749f794a341a1b608d5e0, State: Initialized, Role: FOLLOWER
I20260619 06:38:27.363159 14013 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee3b3d096cc749f794a341a1b608d5e0" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37641 } }
I20260619 06:38:27.363411 14013 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:38:27.363780 14013 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:38:27.363987 14013 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:27.365958 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:38:27.366654 14013 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee3b3d096cc749f794a341a1b608d5e0" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37641 } }
I20260619 06:38:27.367167 14013 leader_election.cc:302] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee3b3d096cc749f794a341a1b608d5e0; no voters:
I20260619 06:38:27.367847 14013 leader_election.cc:288] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:38:27.367962 14018 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:27.370883 14013 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:38:27.375597 14018 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0 [term 1 LEADER]: Becoming Leader. State: Replica: ee3b3d096cc749f794a341a1b608d5e0, State: Running, Role: LEADER
I20260619 06:38:27.376488 14018 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee3b3d096cc749f794a341a1b608d5e0" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37641 } }
I20260619 06:38:27.380298 14020 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee3b3d096cc749f794a341a1b608d5e0. Latest consensus state: current_term: 1 leader_uuid: "ee3b3d096cc749f794a341a1b608d5e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee3b3d096cc749f794a341a1b608d5e0" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37641 } } }
I20260619 06:38:27.380867 14020 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:27.380306 14019 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee3b3d096cc749f794a341a1b608d5e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee3b3d096cc749f794a341a1b608d5e0" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37641 } } }
I20260619 06:38:27.381038 14019 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:27.383337 14031 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:38:27.388550 14031 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:38:27.399135 14031 catalog_manager.cc:1347] Generated new cluster ID: 4bf5825c414141d683b7e7fb76d1a6b9
I20260619 06:38:27.399250 14031 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:38:27.411916 14016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:27.402490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47594 (local address 127.10.192.126:37641)
0619 06:38:27.402660 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:27.402666 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:27.403227 (+ 561us) server_negotiation.cc:407] Connection header received
0619 06:38:27.403422 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:27.403428 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:27.403503 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:27.403609 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:27.404976 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:27.406045 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:27.408009 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:27.408661 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:27.408780 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:27.410010 (+ 1230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:27.410017 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:27.410021 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:38:27.410864 (+ 843us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:27.410939 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:38:27.410971 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:27.411068 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:27.411241 (+ 173us) server_negotiation.cc:299] Negotiation successful
0619 06:38:27.411341 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260619 06:38:27.425774 14031 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:38:27.427321 14031 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:38:27.442706 14031 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee3b3d096cc749f794a341a1b608d5e0: Generated new TSK 0
I20260619 06:38:27.443758 14031 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:38:27.452016 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 13946
I20260619 06:38:27.453263 14008 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:27.545637 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 13946
2026-06-19T06:38:27Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1957 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:38:27 dist-test-slave-7lz4 krb5kdc[14047](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:38:27 dist-test-slave-7lz4 krb5kdc[14047](info): set up 2 sockets
Jun 19 06:38:27 dist-test-slave-7lz4 krb5kdc[14047](info): commencing operation
krb5kdc: starting...
W20260619 06:38:28.628067 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.045s user 0.007s sys 0.011s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:38:28 dist-test-slave-7lz4 krb5kdc[14047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:38:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:38:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:38:28.835191 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:41767
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:46259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:41767
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:29.166918 14060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:29.167276 14060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:29.167443 14060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:29.174876 14060 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:38:29.175026 14060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:29.175134 14060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:29.175225 14060 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:38:29.175305 14060 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:38:29.185451 14060 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:46259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:41767
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:41767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:29.186868 14060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:29.188205 14060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:29.200721 14065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:29.200670 14066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:29.200695 14068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:29.201647 14060 server_base.cc:1034] running on GCE node
I20260619 06:38:29.202471 14060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:29.204121 14060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:29.205358 14060 hybrid_clock.cc:648] HybridClock initialized: now 1781851109205307 us; error 38 us; skew 500 ppm
I20260619 06:38:29.205708 14060 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:29 dist-test-slave-7lz4 krb5kdc[14047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851109, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:29.209283 14060 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:38:29.210866 14060 webserver.cc:460] Webserver started at http://127.10.192.126:33801/ using document root <none> and password file <none>
I20260619 06:38:29.211577 14060 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:29.211745 14060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:29.212069 14060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:29.215126 14060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "4c4b32839ad54fa5868fe008b14a0855"
format_stamp: "Formatted at 2026-06-19 06:38:29 on dist-test-slave-7lz4"
server_key: "9fd615d5236f7bfaca54da1a41d962b7"
server_key_iv: "7f58a52d5f1fecf73e3266e579d8a21a"
server_key_version: "encryptionkey@0"
I20260619 06:38:29.215947 14060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "4c4b32839ad54fa5868fe008b14a0855"
format_stamp: "Formatted at 2026-06-19 06:38:29 on dist-test-slave-7lz4"
server_key: "9fd615d5236f7bfaca54da1a41d962b7"
server_key_iv: "7f58a52d5f1fecf73e3266e579d8a21a"
server_key_version: "encryptionkey@0"
I20260619 06:38:29.221213 14060 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260619 06:38:29.224778 14075 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:29.226166 14060 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:38:29.226361 14060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "4c4b32839ad54fa5868fe008b14a0855"
format_stamp: "Formatted at 2026-06-19 06:38:29 on dist-test-slave-7lz4"
server_key: "9fd615d5236f7bfaca54da1a41d962b7"
server_key_iv: "7f58a52d5f1fecf73e3266e579d8a21a"
server_key_version: "encryptionkey@0"
I20260619 06:38:29.226560 14060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:29.251542 14060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:29.256028 14060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:29.256399 14060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:29.274713 14060 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:41767
I20260619 06:38:29.274731 14126 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:41767 every 8 connection(s)
I20260619 06:38:29.276157 14060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:38:29.279928 14127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:29.284878 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 14060
I20260619 06:38:29.285084 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:38:29.285734 11009 external_mini_cluster.cc:1428] Setting key b5fc3fff094551d0e07ef0306bf3489d
I20260619 06:38:29.290830 14127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855: Bootstrap starting.
I20260619 06:38:29.294726 14127 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:29.296047 14127 log.cc:824] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:29.299821 14127 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855: No bootstrap required, opened a new log
Jun 19 06:38:29 dist-test-slave-7lz4 krb5kdc[14047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:29.307585 14127 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c4b32839ad54fa5868fe008b14a0855" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 41767 } }
I20260619 06:38:29.308066 14127 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:29.308198 14127 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c4b32839ad54fa5868fe008b14a0855, State: Initialized, Role: FOLLOWER
I20260619 06:38:29.308866 14127 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c4b32839ad54fa5868fe008b14a0855" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 41767 } }
I20260619 06:38:29.309126 14127 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:38:29.309275 14127 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:38:29.309468 14127 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:29.309881 14130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:29.287754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50282 (local address 127.10.192.126:41767)
0619 06:38:29.288608 (+ 854us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:29.288621 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:29.288662 (+ 41us) server_negotiation.cc:407] Connection header received
0619 06:38:29.290340 (+ 1678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:29.290365 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:29.290769 (+ 404us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:29.291159 (+ 390us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:29.292913 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:29.294249 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:29.296195 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:29.297273 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:29.297489 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:29.302142 (+ 4653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:29.302153 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:29.302169 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:29.302209 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:29.305463 (+ 3254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:29.306206 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:29.306221 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:29.306228 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:29.306411 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:29.306812 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:29.306816 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:29.306818 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:29.307368 (+ 550us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:29.307715 (+ 347us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:29.308164 (+ 449us) server_negotiation.cc:299] Negotiation successful
0619 06:38:29.308664 (+ 500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":401,"threads_started":1}
I20260619 06:38:29.312005 14127 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c4b32839ad54fa5868fe008b14a0855" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 41767 } }
I20260619 06:38:29.312537 14127 leader_election.cc:302] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c4b32839ad54fa5868fe008b14a0855; no voters:
I20260619 06:38:29.313199 14127 leader_election.cc:288] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:38:29.313377 14132 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:29.314117 14132 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855 [term 1 LEADER]: Becoming Leader. State: Replica: 4c4b32839ad54fa5868fe008b14a0855, State: Running, Role: LEADER
I20260619 06:38:29.314675 14132 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c4b32839ad54fa5868fe008b14a0855" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 41767 } }
I20260619 06:38:29.315359 14127 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:38:29.317642 14134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c4b32839ad54fa5868fe008b14a0855. Latest consensus state: current_term: 1 leader_uuid: "4c4b32839ad54fa5868fe008b14a0855" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c4b32839ad54fa5868fe008b14a0855" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 41767 } } }
I20260619 06:38:29.317971 14134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:29.318480 14133 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c4b32839ad54fa5868fe008b14a0855" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c4b32839ad54fa5868fe008b14a0855" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 41767 } } }
I20260619 06:38:29.318810 14133 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:29.319696 14139 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:38:29.325158 14139 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:38:29.334563 14139 catalog_manager.cc:1347] Generated new cluster ID: adc00b46e2924b29a04de3dc5adbb995
I20260619 06:38:29.334689 14139 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:38:29.345508 14139 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:38:29.346841 14139 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:38:29.355315 14139 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c4b32839ad54fa5868fe008b14a0855: Generated new TSK 0
I20260619 06:38:29.356312 14139 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
I20260619 06:38:29.411916 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:41767
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:46259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:29.756210 14153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:29.756564 14153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:29.756727 14153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:29.764353 14153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:29.764516 14153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:29.764711 14153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:38:29.774470 14153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:46259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:41767
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:29.775882 14153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:29.777230 14153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:29.790791 14161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:29.790820 14159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:29.791525 14158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:29.792037 14153 server_base.cc:1034] running on GCE node
I20260619 06:38:29.792932 14153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:29.794812 14153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:29.796032 14153 hybrid_clock.cc:648] HybridClock initialized: now 1781851109795978 us; error 55 us; skew 500 ppm
I20260619 06:38:29.796415 14153 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:29 dist-test-slave-7lz4 krb5kdc[14047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851109, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:29.799757 14153 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:38:29.801297 14153 webserver.cc:460] Webserver started at http://127.10.192.65:38499/ using document root <none> and password file <none>
I20260619 06:38:29.802029 14153 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:29.802171 14153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:29.802485 14153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:29.805526 14153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "63fe6d9317414ab79e94bfb252422f71"
format_stamp: "Formatted at 2026-06-19 06:38:29 on dist-test-slave-7lz4"
server_key: "ee557797b84d6587a92e385e6a74b311"
server_key_iv: "9b1cc92abd675410dae9a2f8560822f0"
server_key_version: "encryptionkey@0"
I20260619 06:38:29.806365 14153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "63fe6d9317414ab79e94bfb252422f71"
format_stamp: "Formatted at 2026-06-19 06:38:29 on dist-test-slave-7lz4"
server_key: "ee557797b84d6587a92e385e6a74b311"
server_key_iv: "9b1cc92abd675410dae9a2f8560822f0"
server_key_version: "encryptionkey@0"
I20260619 06:38:29.812096 14153 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260619 06:38:29.816157 14168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:29.817744 14153 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:38:29.817925 14153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "63fe6d9317414ab79e94bfb252422f71"
format_stamp: "Formatted at 2026-06-19 06:38:29 on dist-test-slave-7lz4"
server_key: "ee557797b84d6587a92e385e6a74b311"
server_key_iv: "9b1cc92abd675410dae9a2f8560822f0"
server_key_version: "encryptionkey@0"
I20260619 06:38:29.818151 14153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:29.833088 14153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:29.837643 14153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:29.837960 14153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:29.838954 14153 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:29.840373 14153 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:29.840471 14153 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:29.840606 14153 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:29.840677 14153 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:29.874818 14153 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:43519
I20260619 06:38:29.874837 14280 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:43519 every 8 connection(s)
I20260619 06:38:29.876199 14153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:38:29.884526 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 14153
I20260619 06:38:29.884737 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:38:29.885564 11009 external_mini_cluster.cc:1428] Setting key c47f5dbd92674fad83041274405e993b
Jun 19 06:38:29 dist-test-slave-7lz4 krb5kdc[14047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851109, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:29.898403 14283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:29.878722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:50339 (local address 127.10.192.126:41767)
0619 06:38:29.879192 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:29.879199 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:29.880307 (+ 1108us) server_negotiation.cc:407] Connection header received
0619 06:38:29.882260 (+ 1953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:29.882264 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:29.882332 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:29.882430 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:29.884165 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:29.885347 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:29.887436 (+ 2089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:29.888003 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:29.888145 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:29.891876 (+ 3731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:29.891885 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:29.891893 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:29.891940 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:29.894789 (+ 2849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:29.895895 (+ 1106us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:29.895899 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:29.895902 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:29.896022 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:29.896576 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:29.896580 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:29.896582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:29.896838 (+ 256us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:29.896957 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:29.897941 (+ 984us) server_negotiation.cc:299] Negotiation successful
0619 06:38:29.898126 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345,"thread_start_us":221,"threads_started":1}
I20260619 06:38:29.900271 14284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:29.879300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:41767 (local address 127.10.192.65:50339)
0619 06:38:29.880144 (+ 844us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:29.880186 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:29.881983 (+ 1797us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:29.882648 (+ 665us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:29.882657 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:29.883285 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:29.883968 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:29.883988 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:29.885541 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:29.885546 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:29.887275 (+ 1729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:29.887294 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:29.888232 (+ 938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:29.888238 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:29.888459 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:29.889212 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:29.889235 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:29.891578 (+ 2343us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:29.894965 (+ 3387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:29.894979 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:29.895003 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:29.895747 (+ 744us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:29.896144 (+ 397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:29.896153 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:29.896159 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:29.896452 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:29.896977 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:29.896989 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:29.897511 (+ 522us) client_negotiation.cc:769] Sending connection context
0619 06:38:29.897856 (+ 345us) client_negotiation.cc:240] Negotiation successful
0619 06:38:29.898542 (+ 686us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":378,"threads_started":1}
I20260619 06:38:29.902094 14281 heartbeater.cc:347] Connected to a master server at 127.10.192.126:41767
I20260619 06:38:29.902426 14281 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:29.903201 14281 heartbeater.cc:511] Master 127.10.192.126:41767 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.192.66@KRBTEST.COM; defaulting to no policy
I20260619 06:38:29.905853 14092 ts_manager.cc:194] Registered new tserver with Master: 63fe6d9317414ab79e94bfb252422f71 (127.10.192.65:43519)
I20260619 06:38:29.907544 14092 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:50339
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
I20260619 06:38:29.935019 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:41767
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:46259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:30.264814 14287 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:30.265174 14287 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:30.265344 14287 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:30.272879 14287 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:30.273046 14287 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:30.273216 14287 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:38:30.283483 14287 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:46259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:41767
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:30.284895 14287 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:30.286329 14287 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:30.300081 14292 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:30.300064 14295 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:30.300123 14293 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:30.301051 14287 server_base.cc:1034] running on GCE node
I20260619 06:38:30.301770 14287 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:30.302809 14287 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:30.304036 14287 hybrid_clock.cc:648] HybridClock initialized: now 1781851110303983 us; error 45 us; skew 500 ppm
I20260619 06:38:30.304376 14287 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:30 dist-test-slave-7lz4 krb5kdc[14047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851110, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:30.307590 14287 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:38:30.309130 14287 webserver.cc:460] Webserver started at http://127.10.192.66:42707/ using document root <none> and password file <none>
I20260619 06:38:30.309804 14287 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:30.309903 14287 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:30.310158 14287 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:30.313268 14287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "8f0736fd14bf4b0b8f57faf44aa92406"
format_stamp: "Formatted at 2026-06-19 06:38:30 on dist-test-slave-7lz4"
server_key: "36c2132c9e5b5599bb04cde0b700e750"
server_key_iv: "8b0a47fa670e68769c29a70ab46a16f0"
server_key_version: "encryptionkey@0"
I20260619 06:38:30.314031 14287 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "8f0736fd14bf4b0b8f57faf44aa92406"
format_stamp: "Formatted at 2026-06-19 06:38:30 on dist-test-slave-7lz4"
server_key: "36c2132c9e5b5599bb04cde0b700e750"
server_key_iv: "8b0a47fa670e68769c29a70ab46a16f0"
server_key_version: "encryptionkey@0"
I20260619 06:38:30.319702 14287 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260619 06:38:30.324057 14302 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:30.325614 14287 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260619 06:38:30.325762 14287 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "8f0736fd14bf4b0b8f57faf44aa92406"
format_stamp: "Formatted at 2026-06-19 06:38:30 on dist-test-slave-7lz4"
server_key: "36c2132c9e5b5599bb04cde0b700e750"
server_key_iv: "8b0a47fa670e68769c29a70ab46a16f0"
server_key_version: "encryptionkey@0"
I20260619 06:38:30.325945 14287 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:30.349433 14287 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:30.353791 14287 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:30.354058 14287 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:30.354982 14287 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:30.356405 14287 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:30.356482 14287 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:30.356565 14287 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:30.356609 14287 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:30.390295 14287 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:37073
I20260619 06:38:30.390336 14414 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:37073 every 8 connection(s)
I20260619 06:38:30.391714 14287 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:38:30.394649 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 14287
I20260619 06:38:30.394824 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:38:30.395267 11009 external_mini_cluster.cc:1428] Setting key 1ce83906b4717fb3912ee7ca9d2acd7a
Jun 19 06:38:30 dist-test-slave-7lz4 krb5kdc[14047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851110, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.192.67@KRBTEST.COM; defaulting to no policy
I20260619 06:38:30.413810 14283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:30.394274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:34025 (local address 127.10.192.126:41767)
0619 06:38:30.394477 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:30.394482 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:30.395897 (+ 1415us) server_negotiation.cc:407] Connection header received
0619 06:38:30.397955 (+ 2058us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:30.397963 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:30.398062 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:30.398175 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:30.399765 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:30.400945 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:30.402579 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:30.403282 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:30.403389 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:30.407654 (+ 4265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:30.407663 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:30.407669 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:30.407710 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:30.410422 (+ 2712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:30.411326 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:30.411333 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:30.411336 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:30.411503 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:30.411996 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:30.412001 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:30.412009 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:30.412316 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:30.412474 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:30.413206 (+ 732us) server_negotiation.cc:299] Negotiation successful
0619 06:38:30.413446 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260619 06:38:30.415019 14417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:30.394853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:41767 (local address 127.10.192.66:34025)
0619 06:38:30.395731 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:30.395779 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:30.397680 (+ 1901us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:30.398430 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:30.398440 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:30.398971 (+ 531us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:30.399551 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:30.399568 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:30.401085 (+ 1517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:30.401089 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:30.402435 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:30.402449 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:30.403504 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:30.403513 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:30.403891 (+ 378us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:30.404658 (+ 767us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:30.404693 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:30.407389 (+ 2696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:30.410576 (+ 3187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:30.410586 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:30.410605 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:30.411167 (+ 562us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:30.411650 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:30.411659 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:30.411663 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:30.411875 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:30.412446 (+ 571us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:30.412455 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:30.412825 (+ 370us) client_negotiation.cc:769] Sending connection context
0619 06:38:30.413106 (+ 281us) client_negotiation.cc:240] Negotiation successful
0619 06:38:30.413698 (+ 592us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":328,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.67@KRBTEST.COM" created.
I20260619 06:38:30.416788 14415 heartbeater.cc:347] Connected to a master server at 127.10.192.126:41767
I20260619 06:38:30.417132 14415 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:30.417994 14415 heartbeater.cc:511] Master 127.10.192.126:41767 requested a full tablet report, sending...
I20260619 06:38:30.419605 14092 ts_manager.cc:194] Registered new tserver with Master: 8f0736fd14bf4b0b8f57faf44aa92406 (127.10.192.66:37073)
I20260619 06:38:30.420979 14092 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:34025
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
I20260619 06:38:30.442178 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:41767
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:46259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:30.770713 14420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:30.771013 14420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:30.771171 14420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:30.778836 14420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:30.778972 14420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:30.779150 14420 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:38:30.789207 14420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:46259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:41767
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:30.790566 14420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:30.791846 14420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:30.811497 14425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:30.811563 14426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:30.811550 14428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:30.812362 14420 server_base.cc:1034] running on GCE node
I20260619 06:38:30.813088 14420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:30.814121 14420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:30.815377 14420 hybrid_clock.cc:648] HybridClock initialized: now 1781851110815329 us; error 61 us; skew 500 ppm
I20260619 06:38:30.815809 14420 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:30 dist-test-slave-7lz4 krb5kdc[14047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851110, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:30.819084 14420 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:38:30.821012 14420 webserver.cc:460] Webserver started at http://127.10.192.67:37201/ using document root <none> and password file <none>
I20260619 06:38:30.821750 14420 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:30.821900 14420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:30.822202 14420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:30.825307 14420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "ec6fb23b831d4c028dbb9589eed8f0ef"
format_stamp: "Formatted at 2026-06-19 06:38:30 on dist-test-slave-7lz4"
server_key: "a5e01b58c99ee7bdfcd209e2297438d3"
server_key_iv: "786b2600260b41587424f3a034ecd7c0"
server_key_version: "encryptionkey@0"
I20260619 06:38:30.826129 14420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "ec6fb23b831d4c028dbb9589eed8f0ef"
format_stamp: "Formatted at 2026-06-19 06:38:30 on dist-test-slave-7lz4"
server_key: "a5e01b58c99ee7bdfcd209e2297438d3"
server_key_iv: "786b2600260b41587424f3a034ecd7c0"
server_key_version: "encryptionkey@0"
I20260619 06:38:30.831915 14420 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 06:38:30.835399 14435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:30.836927 14420 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:38:30.837123 14420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "ec6fb23b831d4c028dbb9589eed8f0ef"
format_stamp: "Formatted at 2026-06-19 06:38:30 on dist-test-slave-7lz4"
server_key: "a5e01b58c99ee7bdfcd209e2297438d3"
server_key_iv: "786b2600260b41587424f3a034ecd7c0"
server_key_version: "encryptionkey@0"
I20260619 06:38:30.837333 14420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:30.848748 14420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:30.852689 14420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:30.853006 14420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:30.853924 14420 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:30.855257 14420 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:30.855356 14420 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:30.855496 14420 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:30.855562 14420 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:30.887126 14420 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:38981
I20260619 06:38:30.887168 14547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:38981 every 8 connection(s)
I20260619 06:38:30.888504 14420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:38:30.891770 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 14420
I20260619 06:38:30.891937 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:38:30.892581 11009 external_mini_cluster.cc:1428] Setting key 8fca3172e3b4cd97d6f823c8035e12f9
Jun 19 06:38:30 dist-test-slave-7lz4 krb5kdc[14047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851110, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:30.909178 14283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:30.891310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:33545 (local address 127.10.192.126:41767)
0619 06:38:30.891560 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:30.891568 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:30.892926 (+ 1358us) server_negotiation.cc:407] Connection header received
0619 06:38:30.895017 (+ 2091us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:30.895023 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:30.895138 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:30.895240 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:30.896859 (+ 1619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:30.897597 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:30.899093 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:30.899504 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:30.899611 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:30.902995 (+ 3384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:30.903000 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:30.903003 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:30.903036 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:30.905702 (+ 2666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:30.906581 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:30.906585 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:30.906588 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:30.906788 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:30.907322 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:30.907326 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:30.907328 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:30.907788 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:30.907939 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:30.908740 (+ 801us) server_negotiation.cc:299] Negotiation successful
0619 06:38:30.908917 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260619 06:38:30.910214 14550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:30.891822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:41767 (local address 127.10.192.67:33545)
0619 06:38:30.892716 (+ 894us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:30.892778 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:30.894719 (+ 1941us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:30.895517 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:30.895526 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:30.896146 (+ 620us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:30.896708 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:30.896725 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:30.897723 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:30.897726 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:30.898960 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:30.898976 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:30.899741 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:30.899747 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:30.899958 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:30.900663 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:30.900686 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:30.902786 (+ 2100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:30.905866 (+ 3080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:30.905876 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:30.905892 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:30.906451 (+ 559us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:30.906907 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:30.906926 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:30.906932 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:30.907203 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:30.907908 (+ 705us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:30.907915 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:30.908369 (+ 454us) client_negotiation.cc:769] Sending connection context
0619 06:38:30.908616 (+ 247us) client_negotiation.cc:240] Negotiation successful
0619 06:38:30.909023 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":310,"threads_started":1}
I20260619 06:38:30.911763 14548 heartbeater.cc:347] Connected to a master server at 127.10.192.126:41767
I20260619 06:38:30.911852 14281 heartbeater.cc:503] Master 127.10.192.126:41767 was elected leader, sending a full tablet report...
I20260619 06:38:30.912098 14548 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:30.912905 14548 heartbeater.cc:511] Master 127.10.192.126:41767 requested a full tablet report, sending...
I20260619 06:38:30.914420 14092 ts_manager.cc:194] Registered new tserver with Master: ec6fb23b831d4c028dbb9589eed8f0ef (127.10.192.67:38981)
I20260619 06:38:30.915305 14092 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:33545
I20260619 06:38:30.920431 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 19 06:38:30 dist-test-slave-7lz4 krb5kdc[14047](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851110, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Jun 19 06:38:30 dist-test-slave-7lz4 krb5kdc[14047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851110, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:30.968524 14283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:30.954528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50284 (local address 127.10.192.126:41767)
0619 06:38:30.954756 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:30.954764 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:30.955147 (+ 383us) server_negotiation.cc:407] Connection header received
0619 06:38:30.955359 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:30.955363 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:30.955428 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:30.955539 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:30.956887 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:30.957636 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:30.958859 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:30.959276 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:30.959409 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:30.963204 (+ 3795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:30.963209 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:30.963212 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:30.963245 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:30.966041 (+ 2796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:30.966689 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:30.966693 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:30.966695 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:30.966844 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:30.967246 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:30.967249 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:30.967251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:30.967631 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:30.967884 (+ 253us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:30.968131 (+ 247us) server_negotiation.cc:299] Negotiation successful
0619 06:38:30.968299 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260619 06:38:30.969141 14092 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:50284
I20260619 06:38:30.970793 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 14153
Jun 19 06:38:30 dist-test-slave-7lz4 krb5kdc[14047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851110, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:38:30.986033 14559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:30.971806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49924 (local address 127.10.192.65:43519)
0619 06:38:30.972440 (+ 634us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:30.972447 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:30.972471 (+ 24us) server_negotiation.cc:407] Connection header received
0619 06:38:30.972525 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:30.972531 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:30.972740 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:30.972874 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:30.973916 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:30.974923 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:30.976134 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:30.976688 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:30.976787 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:30.980623 (+ 3836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:30.980635 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:30.980649 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:30.980688 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:30.983528 (+ 2840us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:30.984242 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:30.984249 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:30.984251 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:30.984368 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:30.984672 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:30.984675 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:30.984677 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:30.985018 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:30.985236 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:30.985543 (+ 307us) server_negotiation.cc:299] Negotiation successful
0619 06:38:30.985736 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":335,"threads_started":1}
W20260619 06:38:30.987301 14276 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:49924
W20260619 06:38:30.988487 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 14153: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:38:30.988668 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 14153
I20260619 06:38:31.004493 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 14287
Jun 19 06:38:31 dist-test-slave-7lz4 krb5kdc[14047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851110, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.192.66@KRBTEST.COM
I20260619 06:38:31.019490 14560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:31.005448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34334 (local address 127.10.192.66:37073)
0619 06:38:31.005954 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:31.005961 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:31.005987 (+ 26us) server_negotiation.cc:407] Connection header received
0619 06:38:31.006055 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:31.006061 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:31.006269 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:31.006404 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:31.007582 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:31.008594 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:31.009765 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:31.010278 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:31.010374 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:31.014356 (+ 3982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:31.014367 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:31.014383 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:31.014413 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:31.017210 (+ 2797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:31.017794 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:31.017802 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:31.017804 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:31.017920 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:31.018231 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:31.018234 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:31.018236 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:31.018565 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:31.018790 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:31.019002 (+ 212us) server_negotiation.cc:299] Negotiation successful
0619 06:38:31.019188 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":275,"threads_started":1}
W20260619 06:38:31.020839 14410 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:34334
W20260619 06:38:31.021955 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 14287: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:38:31.022094 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 14287
I20260619 06:38:31.037256 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 14420
Jun 19 06:38:31 dist-test-slave-7lz4 krb5kdc[14047](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851110, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.10.192.67@KRBTEST.COM
I20260619 06:38:31.053382 14561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:31.038156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60690 (local address 127.10.192.67:38981)
0619 06:38:31.038808 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:31.038815 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:31.038844 (+ 29us) server_negotiation.cc:407] Connection header received
0619 06:38:31.038906 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:31.038912 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:31.039120 (+ 208us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:31.039284 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:31.040678 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:31.041773 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:31.043064 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:31.043613 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:31.043875 (+ 262us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:31.047954 (+ 4079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:31.047965 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:31.047980 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:31.048013 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:31.050579 (+ 2566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:31.051233 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:31.051246 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:31.051249 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:31.051400 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:31.051800 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:31.051806 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:31.051810 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:31.052141 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:31.052476 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:31.052721 (+ 245us) server_negotiation.cc:299] Negotiation successful
0619 06:38:31.052989 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":511,"thread_start_us":342,"threads_started":1}
W20260619 06:38:31.054663 14543 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:60690
W20260619 06:38:31.055893 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 14420: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:38:31.056063 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 14420
I20260619 06:38:31.071178 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 14060
I20260619 06:38:31.072376 14122 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:31.173326 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 14060
2026-06-19T06:38:31Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (3632 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:38:31 dist-test-slave-7lz4 krb5kdc[14565](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:38:31 dist-test-slave-7lz4 krb5kdc[14565](info): set up 2 sockets
Jun 19 06:38:31 dist-test-slave-7lz4 krb5kdc[14565](info): commencing operation
krb5kdc: starting...
W20260619 06:38:32.260293 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.007s sys 0.009s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:38:32 dist-test-slave-7lz4 krb5kdc[14565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:38:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:38:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:38:32.459323 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:35229
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:42451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:35229
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:32.797619 14578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:32.797945 14578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:32.798128 14578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:32.805467 14578 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:38:32.805593 14578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:32.805684 14578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:32.805786 14578 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:38:32.805868 14578 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:38:32.817263 14578 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:42451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:35229
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:35229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:32.818629 14578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:32.820024 14578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:32.831539 14583 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:32.831744 14584 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:32.831707 14586 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:32.832734 14578 server_base.cc:1034] running on GCE node
I20260619 06:38:32.833515 14578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:32.834872 14578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:32.836068 14578 hybrid_clock.cc:648] HybridClock initialized: now 1781851112836030 us; error 32 us; skew 500 ppm
I20260619 06:38:32.836418 14578 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:32 dist-test-slave-7lz4 krb5kdc[14565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851112, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:32.839428 14578 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:38:32.840931 14578 webserver.cc:460] Webserver started at http://127.10.192.126:41941/ using document root <none> and password file <none>
I20260619 06:38:32.841589 14578 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:32.841683 14578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:32.841941 14578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:32.844892 14578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "3f746bd6a7fa429b9a1fc685d0bc91e7"
format_stamp: "Formatted at 2026-06-19 06:38:32 on dist-test-slave-7lz4"
server_key: "ff2fd5dbcf03cc0988513e79ee280e45"
server_key_iv: "f3b08b2ea8a84fa021e0b85cc43f880a"
server_key_version: "encryptionkey@0"
I20260619 06:38:32.845614 14578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "3f746bd6a7fa429b9a1fc685d0bc91e7"
format_stamp: "Formatted at 2026-06-19 06:38:32 on dist-test-slave-7lz4"
server_key: "ff2fd5dbcf03cc0988513e79ee280e45"
server_key_iv: "f3b08b2ea8a84fa021e0b85cc43f880a"
server_key_version: "encryptionkey@0"
I20260619 06:38:32.850521 14578 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 06:38:32.853842 14593 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:32.855123 14578 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260619 06:38:32.855281 14578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "3f746bd6a7fa429b9a1fc685d0bc91e7"
format_stamp: "Formatted at 2026-06-19 06:38:32 on dist-test-slave-7lz4"
server_key: "ff2fd5dbcf03cc0988513e79ee280e45"
server_key_iv: "f3b08b2ea8a84fa021e0b85cc43f880a"
server_key_version: "encryptionkey@0"
I20260619 06:38:32.855453 14578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:32.869354 14578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:32.873136 14578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:32.873427 14578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:32.890930 14578 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:35229
I20260619 06:38:32.890952 14644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:35229 every 8 connection(s)
I20260619 06:38:32.892354 14578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:38:32.896130 14645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:32.899106 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 14578
I20260619 06:38:32.899338 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:38:32.900125 11009 external_mini_cluster.cc:1428] Setting key d505fff1e529e623a27b1453c402246f
I20260619 06:38:32.908746 14645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7: Bootstrap starting.
I20260619 06:38:32.912477 14645 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:32.913784 14645 log.cc:824] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7: Log is configured to *not* fsync() on all Append() calls
Jun 19 06:38:32 dist-test-slave-7lz4 krb5kdc[14565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:32.916774 14645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7: No bootstrap required, opened a new log
I20260619 06:38:32.923249 14648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:32.902168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56294 (local address 127.10.192.126:35229)
0619 06:38:32.902908 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:32.902919 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:32.902961 (+ 42us) server_negotiation.cc:407] Connection header received
0619 06:38:32.904659 (+ 1698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:32.904680 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:32.905078 (+ 398us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:32.905391 (+ 313us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:32.907164 (+ 1773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:32.908498 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:32.910240 (+ 1742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:32.910905 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:32.911026 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:32.915942 (+ 4916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:32.915951 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:32.915966 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:32.916005 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:32.919111 (+ 3106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:32.919891 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:32.919898 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:32.919904 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:32.920079 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:32.920459 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:32.920468 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:32.920470 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:32.921027 (+ 557us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:32.921360 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:32.921769 (+ 409us) server_negotiation.cc:299] Negotiation successful
0619 06:38:32.922191 (+ 422us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":542,"thread_start_us":351,"threads_started":1}
I20260619 06:38:32.925024 14645 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f746bd6a7fa429b9a1fc685d0bc91e7" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35229 } }
I20260619 06:38:32.925414 14645 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:32.925520 14645 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f746bd6a7fa429b9a1fc685d0bc91e7, State: Initialized, Role: FOLLOWER
I20260619 06:38:32.926168 14645 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f746bd6a7fa429b9a1fc685d0bc91e7" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35229 } }
I20260619 06:38:32.926463 14645 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:38:32.926584 14645 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:38:32.926697 14645 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:32.928862 14645 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f746bd6a7fa429b9a1fc685d0bc91e7" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35229 } }
I20260619 06:38:32.929440 14645 leader_election.cc:302] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f746bd6a7fa429b9a1fc685d0bc91e7; no voters:
I20260619 06:38:32.930009 14645 leader_election.cc:288] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:38:32.930145 14650 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:32.930802 14650 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7 [term 1 LEADER]: Becoming Leader. State: Replica: 3f746bd6a7fa429b9a1fc685d0bc91e7, State: Running, Role: LEADER
I20260619 06:38:32.931337 14650 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f746bd6a7fa429b9a1fc685d0bc91e7" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35229 } }
I20260619 06:38:32.932092 14645 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:38:32.934010 14652 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f746bd6a7fa429b9a1fc685d0bc91e7. Latest consensus state: current_term: 1 leader_uuid: "3f746bd6a7fa429b9a1fc685d0bc91e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f746bd6a7fa429b9a1fc685d0bc91e7" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35229 } } }
I20260619 06:38:32.934393 14652 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:32.936174 14651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f746bd6a7fa429b9a1fc685d0bc91e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f746bd6a7fa429b9a1fc685d0bc91e7" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35229 } } }
I20260619 06:38:32.936543 14651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:32.938390 14657 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:38:32.943593 14657 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:38:32.953260 14657 catalog_manager.cc:1347] Generated new cluster ID: d0f3c5d62a0a4cc685a392d658c95fd5
I20260619 06:38:32.953413 14657 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:38:32.967567 14657 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:38:32.968900 14657 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:38:32.977617 14657 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f746bd6a7fa429b9a1fc685d0bc91e7: Generated new TSK 0
I20260619 06:38:32.978474 14657 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
I20260619 06:38:33.028084 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:35229
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:42451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:33.356439 14671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:33.356726 14671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:33.356877 14671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:33.364506 14671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:33.364629 14671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:33.364815 14671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:38:33.374784 14671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:42451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:35229
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:33.376224 14671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:33.377651 14671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:33.391414 14677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:33.391537 14676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:33.391531 14679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:33.392539 14671 server_base.cc:1034] running on GCE node
I20260619 06:38:33.393149 14671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:33.394088 14671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:33.395290 14671 hybrid_clock.cc:648] HybridClock initialized: now 1781851113395249 us; error 31 us; skew 500 ppm
I20260619 06:38:33.395586 14671 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:33 dist-test-slave-7lz4 krb5kdc[14565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851113, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:33.398785 14671 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:38:33.400373 14671 webserver.cc:460] Webserver started at http://127.10.192.65:36721/ using document root <none> and password file <none>
I20260619 06:38:33.401104 14671 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:33.401234 14671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:33.401557 14671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:33.404649 14671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "56943e4a6ca841f9a055d954acc391f3"
format_stamp: "Formatted at 2026-06-19 06:38:33 on dist-test-slave-7lz4"
server_key: "429382df162ac0029bd6af9a926a364a"
server_key_iv: "724144592346cdc8dbc58e80b75b36a6"
server_key_version: "encryptionkey@0"
I20260619 06:38:33.405465 14671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "56943e4a6ca841f9a055d954acc391f3"
format_stamp: "Formatted at 2026-06-19 06:38:33 on dist-test-slave-7lz4"
server_key: "429382df162ac0029bd6af9a926a364a"
server_key_iv: "724144592346cdc8dbc58e80b75b36a6"
server_key_version: "encryptionkey@0"
I20260619 06:38:33.410877 14671 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260619 06:38:33.414636 14686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:33.416312 14671 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:38:33.416512 14671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "56943e4a6ca841f9a055d954acc391f3"
format_stamp: "Formatted at 2026-06-19 06:38:33 on dist-test-slave-7lz4"
server_key: "429382df162ac0029bd6af9a926a364a"
server_key_iv: "724144592346cdc8dbc58e80b75b36a6"
server_key_version: "encryptionkey@0"
I20260619 06:38:33.416744 14671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:33.437994 14671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:33.442412 14671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:33.442715 14671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:33.443759 14671 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:33.445143 14671 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:33.445245 14671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:33.445399 14671 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:33.445467 14671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:33.480605 14671 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:38745
I20260619 06:38:33.480639 14798 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:38745 every 8 connection(s)
I20260619 06:38:33.481925 14671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:38:33.487439 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 14671
I20260619 06:38:33.487708 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:38:33.488324 11009 external_mini_cluster.cc:1428] Setting key 68b9a8f53c00ea28b1fc85b0b8401c60
Jun 19 06:38:33 dist-test-slave-7lz4 krb5kdc[14565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851113, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:33.502295 14801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:33.484554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:57655 (local address 127.10.192.126:35229)
0619 06:38:33.484984 (+ 430us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:33.484988 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:33.486020 (+ 1032us) server_negotiation.cc:407] Connection header received
0619 06:38:33.487972 (+ 1952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:33.487978 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:33.488071 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:33.488184 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:33.489766 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:33.490553 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:33.492246 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:33.492637 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:33.492770 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:33.496396 (+ 3626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:33.496402 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:33.496405 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:33.496438 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:33.499114 (+ 2676us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:33.499950 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:33.499960 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:33.499963 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:33.500089 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:33.500524 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:33.500529 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:33.500532 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:33.500803 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:33.500959 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:33.501687 (+ 728us) server_negotiation.cc:299] Negotiation successful
0619 06:38:33.501921 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":213,"threads_started":1}
I20260619 06:38:33.503327 14802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:33.485138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35229 (local address 127.10.192.65:57655)
0619 06:38:33.485832 (+ 694us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:33.485884 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:33.487618 (+ 1734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:33.488460 (+ 842us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:33.488473 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:33.489016 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:33.489595 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:33.489613 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:33.490707 (+ 1094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:33.490712 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:33.492082 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:33.492095 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:33.492891 (+ 796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:33.492898 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:33.493134 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:33.493849 (+ 715us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:33.493891 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:33.496140 (+ 2249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:33.499271 (+ 3131us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:33.499280 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:33.499301 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:33.499821 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:33.500200 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:33.500205 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:33.500209 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:33.500407 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:33.500935 (+ 528us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:33.500944 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:33.501311 (+ 367us) client_negotiation.cc:769] Sending connection context
0619 06:38:33.501587 (+ 276us) client_negotiation.cc:240] Negotiation successful
0619 06:38:33.502172 (+ 585us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":269,"threads_started":1}
I20260619 06:38:33.505215 14799 heartbeater.cc:347] Connected to a master server at 127.10.192.126:35229
I20260619 06:38:33.505556 14799 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.10.192.66@KRBTEST.COM; defaulting to no policy
I20260619 06:38:33.506352 14799 heartbeater.cc:511] Master 127.10.192.126:35229 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.66@KRBTEST.COM" created.
I20260619 06:38:33.508774 14610 ts_manager.cc:194] Registered new tserver with Master: 56943e4a6ca841f9a055d954acc391f3 (127.10.192.65:38745)
I20260619 06:38:33.510255 14610 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:57655
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
I20260619 06:38:33.531175 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:35229
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:42451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:33.864251 14805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:33.864566 14805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:33.864718 14805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:33.872228 14805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:33.872359 14805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:33.872536 14805 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:38:33.883225 14805 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:42451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:35229
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:33.884684 14805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:33.886049 14805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:33.900049 14813 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:33.900091 14811 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:33.900527 14810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:33.908638 14805 server_base.cc:1034] running on GCE node
I20260619 06:38:33.909457 14805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:33.910513 14805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:33.911731 14805 hybrid_clock.cc:648] HybridClock initialized: now 1781851113911661 us; error 70 us; skew 500 ppm
I20260619 06:38:33.912072 14805 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:33 dist-test-slave-7lz4 krb5kdc[14565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851113, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:33.915454 14805 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:38:33.917133 14805 webserver.cc:460] Webserver started at http://127.10.192.66:40587/ using document root <none> and password file <none>
I20260619 06:38:33.917884 14805 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:33.918044 14805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:33.918356 14805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:33.921653 14805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "680be90f459b412b9d4d2f47c78ed3b1"
format_stamp: "Formatted at 2026-06-19 06:38:33 on dist-test-slave-7lz4"
server_key: "4890b0f8a1e0f07b5145df62b024d76c"
server_key_iv: "725868c610d2e4f3d0bc3bfe52ec7cce"
server_key_version: "encryptionkey@0"
I20260619 06:38:33.922550 14805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "680be90f459b412b9d4d2f47c78ed3b1"
format_stamp: "Formatted at 2026-06-19 06:38:33 on dist-test-slave-7lz4"
server_key: "4890b0f8a1e0f07b5145df62b024d76c"
server_key_iv: "725868c610d2e4f3d0bc3bfe52ec7cce"
server_key_version: "encryptionkey@0"
I20260619 06:38:33.928001 14805 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260619 06:38:33.931847 14820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:33.933344 14805 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:38:33.933547 14805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "680be90f459b412b9d4d2f47c78ed3b1"
format_stamp: "Formatted at 2026-06-19 06:38:33 on dist-test-slave-7lz4"
server_key: "4890b0f8a1e0f07b5145df62b024d76c"
server_key_iv: "725868c610d2e4f3d0bc3bfe52ec7cce"
server_key_version: "encryptionkey@0"
I20260619 06:38:33.933769 14805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:33.948447 14805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:33.953024 14805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:33.953330 14805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:33.954321 14805 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:33.955819 14805 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:33.955919 14805 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:33.956069 14805 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:33.956142 14805 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:33.992148 14805 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:36577
I20260619 06:38:33.992193 14932 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:36577 every 8 connection(s)
I20260619 06:38:33.993611 14805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:38:34.001036 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 14805
I20260619 06:38:34.001263 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:38:34.001677 11009 external_mini_cluster.cc:1428] Setting key 62ba9ad28bcada517b6ff5489a0efd46
Jun 19 06:38:33 dist-test-slave-7lz4 krb5kdc[14565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851113, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:34.014125 14801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:33.996153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:56703 (local address 127.10.192.126:35229)
0619 06:38:33.996364 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:33.996371 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:33.997632 (+ 1261us) server_negotiation.cc:407] Connection header received
0619 06:38:33.999427 (+ 1795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:33.999431 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:33.999501 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:33.999593 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:34.001253 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:34.002036 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:34.003610 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:34.004086 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:34.004213 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:34.007995 (+ 3782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:34.008000 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:34.008003 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:34.008035 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:34.010653 (+ 2618us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:34.011692 (+ 1039us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:34.011696 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:34.011699 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:34.011824 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:34.012335 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:34.012338 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:34.012340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:34.012611 (+ 271us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:34.012719 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:34.013703 (+ 984us) server_negotiation.cc:299] Negotiation successful
0619 06:38:34.013889 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260619 06:38:34.015825 14935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:33.996733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35229 (local address 127.10.192.66:56703)
0619 06:38:33.997448 (+ 715us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:33.997491 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:33.999161 (+ 1670us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:33.999867 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:33.999876 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:34.000402 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:34.000995 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:34.001026 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:34.002185 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:34.002195 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:34.003455 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:34.003467 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:34.004315 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:34.004322 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:34.004557 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:34.005268 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:34.005292 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:34.007746 (+ 2454us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:34.010816 (+ 3070us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:34.010829 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:34.010851 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:34.011514 (+ 663us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:34.011947 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:34.011955 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:34.011962 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:34.012228 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:34.012730 (+ 502us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:34.012741 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:34.013235 (+ 494us) client_negotiation.cc:769] Sending connection context
0619 06:38:34.013577 (+ 342us) client_negotiation.cc:240] Negotiation successful
0619 06:38:34.014206 (+ 629us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":482,"thread_start_us":285,"threads_started":1}
I20260619 06:38:34.017419 14933 heartbeater.cc:347] Connected to a master server at 127.10.192.126:35229
I20260619 06:38:34.017765 14933 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:34.018538 14933 heartbeater.cc:511] Master 127.10.192.126:35229 requested a full tablet report, sending...
I20260619 06:38:34.020092 14610 ts_manager.cc:194] Registered new tserver with Master: 680be90f459b412b9d4d2f47c78ed3b1 (127.10.192.66:36577)
WARNING: no policy specified for kudu/127.10.192.67@KRBTEST.COM; defaulting to no policy
I20260619 06:38:34.021008 14610 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:56703
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
I20260619 06:38:34.046123 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:35229
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:42451
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:34.384605 14938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:34.384925 14938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:34.385023 14938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:34.392675 14938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:34.392805 14938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:34.392921 14938 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:38:34.403024 14938 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:42451
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:35229
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:34.404508 14938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:34.405833 14938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:34.419458 14946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:34.419526 14944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:34.419490 14943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:34.420344 14938 server_base.cc:1034] running on GCE node
I20260619 06:38:34.421010 14938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:34.422124 14938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:34.423357 14938 hybrid_clock.cc:648] HybridClock initialized: now 1781851114423313 us; error 34 us; skew 500 ppm
I20260619 06:38:34.423774 14938 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:34 dist-test-slave-7lz4 krb5kdc[14565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851114, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:34.427088 14938 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:38:34.428892 14938 webserver.cc:460] Webserver started at http://127.10.192.67:46399/ using document root <none> and password file <none>
I20260619 06:38:34.429800 14938 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:34.429904 14938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:34.430217 14938 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:34.433578 14938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "3b0e4d329a8b40b887e7ff6bf64f5559"
format_stamp: "Formatted at 2026-06-19 06:38:34 on dist-test-slave-7lz4"
server_key: "e937ac45710b15b5b35c11cf0bc56ca6"
server_key_iv: "5ecc0a946aadc0a4c5ac62570de7d550"
server_key_version: "encryptionkey@0"
I20260619 06:38:34.434377 14938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "3b0e4d329a8b40b887e7ff6bf64f5559"
format_stamp: "Formatted at 2026-06-19 06:38:34 on dist-test-slave-7lz4"
server_key: "e937ac45710b15b5b35c11cf0bc56ca6"
server_key_iv: "5ecc0a946aadc0a4c5ac62570de7d550"
server_key_version: "encryptionkey@0"
I20260619 06:38:34.440135 14938 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260619 06:38:34.443935 14953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:34.445458 14938 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:38:34.445653 14938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "3b0e4d329a8b40b887e7ff6bf64f5559"
format_stamp: "Formatted at 2026-06-19 06:38:34 on dist-test-slave-7lz4"
server_key: "e937ac45710b15b5b35c11cf0bc56ca6"
server_key_iv: "5ecc0a946aadc0a4c5ac62570de7d550"
server_key_version: "encryptionkey@0"
I20260619 06:38:34.445910 14938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:34.460871 14938 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:34.465487 14938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:34.465813 14938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:34.466820 14938 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:34.468400 14938 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:34.468473 14938 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:34.468623 14938 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:34.468683 14938 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:34.502972 14938 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:36025
I20260619 06:38:34.503016 15065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:36025 every 8 connection(s)
I20260619 06:38:34.504455 14938 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:38:34.506259 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 14938
I20260619 06:38:34.506475 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:38:34.507045 11009 external_mini_cluster.cc:1428] Setting key c31d866f5b213f9f99763be521ef468c
I20260619 06:38:34.513516 14799 heartbeater.cc:503] Master 127.10.192.126:35229 was elected leader, sending a full tablet report...
Jun 19 06:38:34 dist-test-slave-7lz4 krb5kdc[14565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851114, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:34.525763 14801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:34.507278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:44557 (local address 127.10.192.126:35229)
0619 06:38:34.507459 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:34.507464 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:34.508876 (+ 1412us) server_negotiation.cc:407] Connection header received
0619 06:38:34.511199 (+ 2323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:34.511204 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:34.511288 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:34.511391 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:34.512989 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:34.513908 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:34.515811 (+ 1903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:34.516229 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:34.516365 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:34.519876 (+ 3511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:34.519882 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:34.519885 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:34.519917 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:34.522900 (+ 2983us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:34.523614 (+ 714us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:34.523617 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:34.523620 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:34.523789 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:34.524184 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:34.524187 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:34.524189 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:34.524448 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:34.524560 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:34.525335 (+ 775us) server_negotiation.cc:299] Negotiation successful
0619 06:38:34.525521 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260619 06:38:34.526889 15068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:34.507911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35229 (local address 127.10.192.67:44557)
0619 06:38:34.508728 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:34.508766 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:34.510929 (+ 2163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:34.511684 (+ 755us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:34.511699 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:34.512229 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:34.512814 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:34.512832 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:34.514049 (+ 1217us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:34.514055 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:34.515617 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:34.515678 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:34.516461 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:34.516470 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:34.516726 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:34.517395 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:34.517418 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:34.519591 (+ 2173us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:34.523044 (+ 3453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:34.523052 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:34.523067 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:34.523506 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:34.523894 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:34.523897 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:34.523899 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:34.524085 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:34.524604 (+ 519us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:34.524611 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:34.524983 (+ 372us) client_negotiation.cc:769] Sending connection context
0619 06:38:34.525243 (+ 260us) client_negotiation.cc:240] Negotiation successful
0619 06:38:34.525693 (+ 450us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":304,"threads_started":1}
I20260619 06:38:34.528422 15066 heartbeater.cc:347] Connected to a master server at 127.10.192.126:35229
I20260619 06:38:34.528721 15066 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:34.529435 15066 heartbeater.cc:511] Master 127.10.192.126:35229 requested a full tablet report, sending...
I20260619 06:38:34.530894 14610 ts_manager.cc:194] Registered new tserver with Master: 3b0e4d329a8b40b887e7ff6bf64f5559 (127.10.192.67:36025)
I20260619 06:38:34.531759 14610 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:44557
I20260619 06:38:34.535418 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 19 06:38:34 dist-test-slave-7lz4 krb5kdc[14565](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 19 06:38:34 dist-test-slave-7lz4 krb5kdc[14565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:38:34.585350 15073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:34.569873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43900 (local address 127.10.192.65:38745)
0619 06:38:34.570555 (+ 682us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:34.570563 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:34.570613 (+ 50us) server_negotiation.cc:407] Connection header received
0619 06:38:34.570671 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:34.570678 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:34.570904 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:34.571029 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:34.572507 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:34.573536 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:34.574868 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:34.575473 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:34.575571 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:34.579526 (+ 3955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:34.579539 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:34.579555 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:34.579591 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:34.582556 (+ 2965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:34.583341 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:34.583348 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:34.583350 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:34.583500 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:34.583986 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:34.583990 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:34.583992 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:34.584337 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:34.584591 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:34.584861 (+ 270us) server_negotiation.cc:299] Negotiation successful
0619 06:38:34.585067 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":532,"thread_start_us":374,"threads_started":1}
Jun 19 06:38:34 dist-test-slave-7lz4 krb5kdc[14565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:34.603897 14801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:34.589941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35818 (local address 127.10.192.126:35229)
0619 06:38:34.590167 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:34.590172 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:34.590255 (+ 83us) server_negotiation.cc:407] Connection header received
0619 06:38:34.590387 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:34.590391 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:34.590459 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:34.590541 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:34.591820 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:34.592548 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:34.593747 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:34.594147 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:34.594238 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:34.598612 (+ 4374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:34.598618 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:34.598621 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:34.598660 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:34.601341 (+ 2681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:34.602022 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:34.602026 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:34.602028 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:34.602150 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:34.602522 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:34.602526 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:34.602528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:34.602865 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:34.603054 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:34.603334 (+ 280us) server_negotiation.cc:299] Negotiation successful
0619 06:38:34.603504 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260619 06:38:34.604490 14610 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35818
I20260619 06:38:34.605563 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 14671
I20260619 06:38:34.618950 15073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:34.606569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43910 (local address 127.10.192.65:38745)
0619 06:38:34.606786 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:34.606792 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:34.606960 (+ 168us) server_negotiation.cc:407] Connection header received
0619 06:38:34.607086 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:34.607090 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:34.607180 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:34.607260 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:34.608730 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:34.609471 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:34.610635 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:34.611090 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:34.611208 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:34.613591 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:34.613596 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:34.613600 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:34.613638 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:34.616514 (+ 2876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:34.617132 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:34.617136 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:34.617139 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:34.617272 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:34.617695 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:34.617699 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:34.617701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:34.617985 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:34.618175 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:34.618538 (+ 363us) server_negotiation.cc:299] Negotiation successful
0619 06:38:34.618706 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260619 06:38:34.619599 14794 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:34.704262 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 14671
I20260619 06:38:34.722276 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 14805
Jun 19 06:38:34 dist-test-slave-7lz4 krb5kdc[14565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.66@KRBTEST.COM
I20260619 06:38:34.739192 15078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:34.723141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52348 (local address 127.10.192.66:36577)
0619 06:38:34.723743 (+ 602us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:34.723750 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:34.723776 (+ 26us) server_negotiation.cc:407] Connection header received
0619 06:38:34.723843 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:34.723850 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:34.724076 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:34.724277 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:34.725489 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:34.726537 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:34.727986 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:34.728592 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:34.728735 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:34.733215 (+ 4480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:34.733227 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:34.733243 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:34.733280 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:34.736278 (+ 2998us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:34.737075 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:34.737083 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:34.737085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:34.737219 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:34.737620 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:34.737624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:34.737626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:34.738030 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:34.738266 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:34.738619 (+ 353us) server_negotiation.cc:299] Negotiation successful
0619 06:38:34.738880 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":274,"threads_started":1}
I20260619 06:38:34.740650 14928 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:34.824144 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 14805
I20260619 06:38:34.840365 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 14938
Jun 19 06:38:34 dist-test-slave-7lz4 krb5kdc[14565](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.67@KRBTEST.COM
I20260619 06:38:34.857298 15080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:34.841218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54202 (local address 127.10.192.67:36025)
0619 06:38:34.841865 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:34.841872 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:34.841903 (+ 31us) server_negotiation.cc:407] Connection header received
0619 06:38:34.841968 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:34.841975 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:34.842191 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:34.842325 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:34.843579 (+ 1254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:34.844718 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:34.846064 (+ 1346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:34.846638 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:34.846736 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:34.851462 (+ 4726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:34.851474 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:34.851490 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:34.851530 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:34.854356 (+ 2826us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:34.855114 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:34.855122 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:34.855124 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:34.855251 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:34.855661 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:34.855668 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:34.855672 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:34.856036 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:34.856369 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:34.856659 (+ 290us) server_negotiation.cc:299] Negotiation successful
0619 06:38:34.856952 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":328,"threads_started":1}
I20260619 06:38:34.858681 15061 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:34.941846 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 14938
I20260619 06:38:34.957271 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 14578
I20260619 06:38:34.958551 14640 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:35.061450 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 14578
2026-06-19T06:38:35Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (3888 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:38:35 dist-test-slave-7lz4 krb5kdc[15085](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:38:35 dist-test-slave-7lz4 krb5kdc[15085](info): set up 2 sockets
Jun 19 06:38:35 dist-test-slave-7lz4 krb5kdc[15085](info): commencing operation
krb5kdc: starting...
W20260619 06:38:36.164183 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.060s user 0.001s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:38:36 dist-test-slave-7lz4 krb5kdc[15085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:38:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:38:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:38:36.369254 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:42983
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:44857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:42983
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:36.689951 15098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:36.690279 15098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:36.690376 15098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:36.697714 15098 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:38:36.697839 15098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:36.697893 15098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:36.697944 15098 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:38:36.697993 15098 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:38:36.712100 15098 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:44857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:42983
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:42983
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:36.713426 15098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:36.714751 15098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:36.726944 15103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:36.726899 15106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:36.727002 15104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:36.727762 15098 server_base.cc:1034] running on GCE node
I20260619 06:38:36.728706 15098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:36.730254 15098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:36.731505 15098 hybrid_clock.cc:648] HybridClock initialized: now 1781851116731465 us; error 65 us; skew 500 ppm
I20260619 06:38:36.731912 15098 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:36 dist-test-slave-7lz4 krb5kdc[15085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851116, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:36.735044 15098 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:38:36.736197 15098 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:36.736286 15098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:36.736568 15098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:36.739535 15098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "656a466aa0ca4aa4ad5b50caefb65ce9"
format_stamp: "Formatted at 2026-06-19 06:38:36 on dist-test-slave-7lz4"
server_key: "a25a9704cd647f7c1f918391f65076a0"
server_key_iv: "0ad3abcee6b83fdc97b47a4b572b625e"
server_key_version: "encryptionkey@0"
I20260619 06:38:36.740389 15098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "656a466aa0ca4aa4ad5b50caefb65ce9"
format_stamp: "Formatted at 2026-06-19 06:38:36 on dist-test-slave-7lz4"
server_key: "a25a9704cd647f7c1f918391f65076a0"
server_key_iv: "0ad3abcee6b83fdc97b47a4b572b625e"
server_key_version: "encryptionkey@0"
I20260619 06:38:36.745491 15098 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 06:38:36.748862 15112 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:36.750213 15098 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:38:36.750429 15098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "656a466aa0ca4aa4ad5b50caefb65ce9"
format_stamp: "Formatted at 2026-06-19 06:38:36 on dist-test-slave-7lz4"
server_key: "a25a9704cd647f7c1f918391f65076a0"
server_key_iv: "0ad3abcee6b83fdc97b47a4b572b625e"
server_key_version: "encryptionkey@0"
I20260619 06:38:36.750648 15098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:36.774410 15098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:36.778839 15098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:36.779145 15098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:36.798190 15098 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:42983
I20260619 06:38:36.798172 15163 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:42983 every 8 connection(s)
I20260619 06:38:36.799181 15098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:38:36.802953 15164 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:36.809222 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 15098
I20260619 06:38:36.809487 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:38:36.810285 11009 external_mini_cluster.cc:1428] Setting key 8870bd2ee74e555635bba9bbdc7a5c8a
I20260619 06:38:36.814853 15164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9: Bootstrap starting.
I20260619 06:38:36.818828 15164 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:36.820078 15164 log.cc:824] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:36.823305 15164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9: No bootstrap required, opened a new log
Jun 19 06:38:36 dist-test-slave-7lz4 krb5kdc[15085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:36.833406 15164 raft_consensus.cc:348] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "656a466aa0ca4aa4ad5b50caefb65ce9" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 42983 } }
I20260619 06:38:36.833907 15164 raft_consensus.cc:374] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:36.834038 15164 raft_consensus.cc:729] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 656a466aa0ca4aa4ad5b50caefb65ce9, State: Initialized, Role: FOLLOWER
I20260619 06:38:36.834787 15164 consensus_queue.cc:260] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "656a466aa0ca4aa4ad5b50caefb65ce9" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 42983 } }
I20260619 06:38:36.835027 15164 raft_consensus.cc:388] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:38:36.835170 15164 raft_consensus.cc:482] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:38:36.835382 15164 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:36.836170 15167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:36.812618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33646 (local address 127.10.192.126:42983)
0619 06:38:36.813466 (+ 848us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:36.813479 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:36.813521 (+ 42us) server_negotiation.cc:407] Connection header received
0619 06:38:36.815254 (+ 1733us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:36.815279 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:36.815763 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:36.816142 (+ 379us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:36.818083 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:36.819545 (+ 1462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:36.821234 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:36.821944 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:36.822080 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:36.827287 (+ 5207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:36.827301 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:36.827356 (+ 55us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:36.827444 (+ 88us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:36.831294 (+ 3850us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:36.832274 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:36.832285 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:36.832294 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:36.832486 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:36.832904 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:36.832908 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:36.832910 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:36.833485 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:36.833717 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:36.834324 (+ 607us) server_negotiation.cc:299] Negotiation successful
0619 06:38:36.834756 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":620,"thread_start_us":407,"threads_started":1}
I20260619 06:38:36.838199 15164 raft_consensus.cc:504] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "656a466aa0ca4aa4ad5b50caefb65ce9" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 42983 } }
I20260619 06:38:36.838801 15164 leader_election.cc:302] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 656a466aa0ca4aa4ad5b50caefb65ce9; no voters:
I20260619 06:38:36.839497 15164 leader_election.cc:288] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:38:36.839648 15169 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:36.840356 15169 raft_consensus.cc:686] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9 [term 1 LEADER]: Becoming Leader. State: Replica: 656a466aa0ca4aa4ad5b50caefb65ce9, State: Running, Role: LEADER
I20260619 06:38:36.840890 15169 consensus_queue.cc:237] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "656a466aa0ca4aa4ad5b50caefb65ce9" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 42983 } }
I20260619 06:38:36.841646 15164 sys_catalog.cc:564] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:38:36.843966 15171 sys_catalog.cc:455] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 656a466aa0ca4aa4ad5b50caefb65ce9. Latest consensus state: current_term: 1 leader_uuid: "656a466aa0ca4aa4ad5b50caefb65ce9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "656a466aa0ca4aa4ad5b50caefb65ce9" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 42983 } } }
I20260619 06:38:36.843961 15170 sys_catalog.cc:455] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "656a466aa0ca4aa4ad5b50caefb65ce9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "656a466aa0ca4aa4ad5b50caefb65ce9" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 42983 } } }
I20260619 06:38:36.844391 15171 sys_catalog.cc:458] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:36.844477 15170 sys_catalog.cc:458] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:36.845407 15176 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:38:36.852180 15176 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:38:36.862294 15176 catalog_manager.cc:1347] Generated new cluster ID: 6360f26f84574f8c95a7db9eb14905ec
I20260619 06:38:36.862452 15176 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:38:36.871098 15176 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:38:36.872604 15176 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:38:36.883052 15176 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9: Generated new TSK 0
I20260619 06:38:36.884272 15176 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
I20260619 06:38:36.939292 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:42983
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:44857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:37.273840 15190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:37.274153 15190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:37.274336 15190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:37.281651 15190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:37.281772 15190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:37.281987 15190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:38:37.292129 15190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:44857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:42983
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:37.293586 15190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:37.294947 15190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:37.307873 15195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:37.307919 15196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:37.307945 15198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:37.309162 15190 server_base.cc:1034] running on GCE node
I20260619 06:38:37.309892 15190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:37.310906 15190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:37.312119 15190 hybrid_clock.cc:648] HybridClock initialized: now 1781851117312065 us; error 42 us; skew 500 ppm
I20260619 06:38:37.312493 15190 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:37 dist-test-slave-7lz4 krb5kdc[15085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851117, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:37.315765 15190 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:38:37.317025 15190 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:37.317142 15190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:37.317480 15190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:37.320631 15190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "96ba0475f7ca4ae1904b4dddb75a9efe"
format_stamp: "Formatted at 2026-06-19 06:38:37 on dist-test-slave-7lz4"
server_key: "333a15efe39e71c8cb21b495845d8ccf"
server_key_iv: "e03f20a9224779a8bb931dcd18f15693"
server_key_version: "encryptionkey@0"
I20260619 06:38:37.321484 15190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "96ba0475f7ca4ae1904b4dddb75a9efe"
format_stamp: "Formatted at 2026-06-19 06:38:37 on dist-test-slave-7lz4"
server_key: "333a15efe39e71c8cb21b495845d8ccf"
server_key_iv: "e03f20a9224779a8bb931dcd18f15693"
server_key_version: "encryptionkey@0"
I20260619 06:38:37.327042 15190 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 06:38:37.330885 15204 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:37.332427 15190 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:38:37.332640 15190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "96ba0475f7ca4ae1904b4dddb75a9efe"
format_stamp: "Formatted at 2026-06-19 06:38:37 on dist-test-slave-7lz4"
server_key: "333a15efe39e71c8cb21b495845d8ccf"
server_key_iv: "e03f20a9224779a8bb931dcd18f15693"
server_key_version: "encryptionkey@0"
I20260619 06:38:37.332878 15190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:37.358999 15190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:37.363517 15190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:37.363873 15190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:37.364914 15190 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:37.366322 15190 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:37.366464 15190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:37.366590 15190 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:37.366676 15190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:37.400364 15190 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:34431
I20260619 06:38:37.400420 15316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:34431 every 8 connection(s)
I20260619 06:38:37.401288 15190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:38:37.409600 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 15190
I20260619 06:38:37.409838 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:38:37.410589 11009 external_mini_cluster.cc:1428] Setting key 19103fc5c9b45be2e10b9ebfae77a6e5
Jun 19 06:38:37 dist-test-slave-7lz4 krb5kdc[15085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851117, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:37.423327 15319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:37.403902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:33337 (local address 127.10.192.126:42983)
0619 06:38:37.404369 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:37.404374 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:37.405309 (+ 935us) server_negotiation.cc:407] Connection header received
0619 06:38:37.407161 (+ 1852us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:37.407167 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:37.407261 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:37.407384 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:37.409065 (+ 1681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:37.410276 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:37.412435 (+ 2159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:37.413084 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:37.413223 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:37.416913 (+ 3690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:37.416922 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:37.416930 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:37.416975 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:37.419941 (+ 2966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:37.420946 (+ 1005us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:37.420950 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:37.420952 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:37.421063 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:37.421557 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:37.421560 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:37.421562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:37.421835 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:37.421944 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:37.422886 (+ 942us) server_negotiation.cc:299] Negotiation successful
0619 06:38:37.423063 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":248,"threads_started":1}
I20260619 06:38:37.425107 15320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:37.404443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:42983 (local address 127.10.192.65:33337)
0619 06:38:37.405144 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:37.405188 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:37.406865 (+ 1677us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:37.407663 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:37.407679 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:37.408241 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:37.408875 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:37.408895 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:37.410454 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:37.410458 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:37.412255 (+ 1797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:37.412271 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:37.413321 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:37.413327 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:37.413564 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:37.414309 (+ 745us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:37.414333 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:37.416636 (+ 2303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:37.420097 (+ 3461us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:37.420109 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:37.420133 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:37.420817 (+ 684us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:37.421180 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:37.421188 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:37.421194 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:37.421438 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:37.421969 (+ 531us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:37.421981 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:37.422476 (+ 495us) client_negotiation.cc:769] Sending connection context
0619 06:38:37.422798 (+ 322us) client_negotiation.cc:240] Negotiation successful
0619 06:38:37.423458 (+ 660us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":472,"thread_start_us":291,"threads_started":1}
I20260619 06:38:37.426846 15317 heartbeater.cc:347] Connected to a master server at 127.10.192.126:42983
I20260619 06:38:37.427240 15317 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:37.428184 15317 heartbeater.cc:511] Master 127.10.192.126:42983 requested a full tablet report, sending...
I20260619 06:38:37.430547 15129 ts_manager.cc:194] Registered new tserver with Master: 96ba0475f7ca4ae1904b4dddb75a9efe (127.10.192.65:34431)
WARNING: no policy specified for kudu/127.10.192.66@KRBTEST.COM; defaulting to no policy
I20260619 06:38:37.432158 15129 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:33337
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
I20260619 06:38:37.458797 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:42983
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:44857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:37.786975 15323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:37.787293 15323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:37.787475 15323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:37.794961 15323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:37.795092 15323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:37.795285 15323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:38:37.805745 15323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:44857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:42983
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:37.807245 15323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:37.808662 15323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:37.823007 15328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:37.823078 15329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:37.823078 15331 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:37.823426 15323 server_base.cc:1034] running on GCE node
I20260619 06:38:37.824465 15323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:37.825435 15323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:37.826656 15323 hybrid_clock.cc:648] HybridClock initialized: now 1781851117826580 us; error 62 us; skew 500 ppm
I20260619 06:38:37.826968 15323 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:37 dist-test-slave-7lz4 krb5kdc[15085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851117, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:37.835690 15323 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:38:37.837069 15323 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:37.837205 15323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:37.837572 15323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:37.840662 15323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "a9d785b56a354323a96d237320d1f0a8"
format_stamp: "Formatted at 2026-06-19 06:38:37 on dist-test-slave-7lz4"
server_key: "593678be04ffa898b38545645a5f235d"
server_key_iv: "5ad5f8c44766203c985307fd36440a4a"
server_key_version: "encryptionkey@0"
I20260619 06:38:37.841465 15323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "a9d785b56a354323a96d237320d1f0a8"
format_stamp: "Formatted at 2026-06-19 06:38:37 on dist-test-slave-7lz4"
server_key: "593678be04ffa898b38545645a5f235d"
server_key_iv: "5ad5f8c44766203c985307fd36440a4a"
server_key_version: "encryptionkey@0"
I20260619 06:38:37.846774 15323 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 06:38:37.850505 15337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:37.852020 15323 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:38:37.852200 15323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "a9d785b56a354323a96d237320d1f0a8"
format_stamp: "Formatted at 2026-06-19 06:38:37 on dist-test-slave-7lz4"
server_key: "593678be04ffa898b38545645a5f235d"
server_key_iv: "5ad5f8c44766203c985307fd36440a4a"
server_key_version: "encryptionkey@0"
I20260619 06:38:37.852437 15323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:37.866150 15323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:37.870360 15323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:37.870654 15323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:37.871645 15323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:37.873036 15323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:37.873121 15323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:37.873277 15323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:37.873361 15323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:37.906683 15323 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:40511
I20260619 06:38:37.906723 15449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:40511 every 8 connection(s)
I20260619 06:38:37.907549 15323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:38:37.908977 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 15323
I20260619 06:38:37.909173 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:38:37.909747 11009 external_mini_cluster.cc:1428] Setting key 731c52942ed582b299af6f4e70750977
Jun 19 06:38:37 dist-test-slave-7lz4 krb5kdc[15085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851117, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:37.931318 15319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:37.910410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:57129 (local address 127.10.192.126:42983)
0619 06:38:37.910640 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:37.910646 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:37.911970 (+ 1324us) server_negotiation.cc:407] Connection header received
0619 06:38:37.914792 (+ 2822us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:37.914796 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:37.914864 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:37.914966 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:37.917170 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:37.917860 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:37.919962 (+ 2102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:37.920721 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:37.920902 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:37.924251 (+ 3349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:37.924260 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:37.924267 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:37.924309 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:37.927887 (+ 3578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:37.928938 (+ 1051us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:37.928942 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:37.928944 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:37.929067 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:37.929597 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:37.929600 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:37.929602 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:37.929848 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:37.929974 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:37.930910 (+ 936us) server_negotiation.cc:299] Negotiation successful
0619 06:38:37.931078 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
WARNING: no policy specified for kudu/127.10.192.67@KRBTEST.COM; defaulting to no policy
I20260619 06:38:37.932758 15452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:37.910941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:42983 (local address 127.10.192.66:57129)
0619 06:38:37.911811 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:37.911864 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:37.914441 (+ 2577us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:37.915259 (+ 818us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:37.915274 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:37.916117 (+ 843us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:37.916972 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:37.917001 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:37.918061 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:37.918068 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:37.919796 (+ 1728us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:37.919808 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:37.920932 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:37.920947 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:37.921140 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:37.921817 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:37.921844 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:37.924006 (+ 2162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:37.928034 (+ 4028us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:37.928047 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:37.928072 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:37.928810 (+ 738us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:37.929175 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:37.929180 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:37.929184 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:37.929477 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:37.929987 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:37.929997 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:37.930496 (+ 499us) client_negotiation.cc:769] Sending connection context
0619 06:38:37.930830 (+ 334us) client_negotiation.cc:240] Negotiation successful
0619 06:38:37.931459 (+ 629us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":320,"threads_started":1}
I20260619 06:38:37.934464 15450 heartbeater.cc:347] Connected to a master server at 127.10.192.126:42983
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.67@KRBTEST.COM" created.
I20260619 06:38:37.934778 15450 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:37.935458 15450 heartbeater.cc:511] Master 127.10.192.126:42983 requested a full tablet report, sending...
I20260619 06:38:37.937136 15129 ts_manager.cc:194] Registered new tserver with Master: a9d785b56a354323a96d237320d1f0a8 (127.10.192.66:40511)
I20260619 06:38:37.938117 15129 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:57129
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
I20260619 06:38:37.959044 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:42983
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:44857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:38.285763 15455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:38.286108 15455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:38.286280 15455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:38.293613 15455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:38.293797 15455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:38.293994 15455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:38:38.304107 15455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:44857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:42983
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:38.305596 15455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:38.306847 15455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:38.319880 15461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:38.319947 15460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:38.319897 15463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:38.320698 15455 server_base.cc:1034] running on GCE node
I20260619 06:38:38.321246 15455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:38.322144 15455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:38.323348 15455 hybrid_clock.cc:648] HybridClock initialized: now 1781851118323314 us; error 34 us; skew 500 ppm
I20260619 06:38:38.323729 15455 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:38 dist-test-slave-7lz4 krb5kdc[15085](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851118, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:38.326720 15455 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:38:38.327891 15455 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:38.328006 15455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:38.328321 15455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:38.331219 15455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "1bbdb96d133e4e2c97cf143e72ae52ad"
format_stamp: "Formatted at 2026-06-19 06:38:38 on dist-test-slave-7lz4"
server_key: "cbcfdff55903b451e9a563921eb28f50"
server_key_iv: "ae0f43cfacc44a030637564ad6831968"
server_key_version: "encryptionkey@0"
I20260619 06:38:38.332067 15455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "1bbdb96d133e4e2c97cf143e72ae52ad"
format_stamp: "Formatted at 2026-06-19 06:38:38 on dist-test-slave-7lz4"
server_key: "cbcfdff55903b451e9a563921eb28f50"
server_key_iv: "ae0f43cfacc44a030637564ad6831968"
server_key_version: "encryptionkey@0"
I20260619 06:38:38.337329 15455 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s
I20260619 06:38:38.340983 15469 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:38.342402 15455 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:38:38.342593 15455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "1bbdb96d133e4e2c97cf143e72ae52ad"
format_stamp: "Formatted at 2026-06-19 06:38:38 on dist-test-slave-7lz4"
server_key: "cbcfdff55903b451e9a563921eb28f50"
server_key_iv: "ae0f43cfacc44a030637564ad6831968"
server_key_version: "encryptionkey@0"
I20260619 06:38:38.342806 15455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:38.366276 15455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:38.371031 15455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:38.371330 15455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:38.372426 15455 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:38.373775 15455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:38.373903 15455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:38.374037 15455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:38.374130 15455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:38.407258 15455 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:43353
I20260619 06:38:38.407346 15581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:43353 every 8 connection(s)
I20260619 06:38:38.408170 15455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:38:38.408622 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 15455
I20260619 06:38:38.408847 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:38:38.409530 11009 external_mini_cluster.cc:1428] Setting key e1e5f5df73299e7bc38f49b83498a57a
Jun 19 06:38:38 dist-test-slave-7lz4 krb5kdc[15085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851118, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:38.429244 15319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:38.411052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:50363 (local address 127.10.192.126:42983)
0619 06:38:38.411243 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:38.411247 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:38.413024 (+ 1777us) server_negotiation.cc:407] Connection header received
0619 06:38:38.414987 (+ 1963us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:38.414991 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:38.415087 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:38.415165 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:38.416898 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.417664 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.419284 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.419779 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.419882 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:38.423197 (+ 3315us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:38.423203 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:38.423207 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:38.423246 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:38.426480 (+ 3234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:38.427203 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:38.427208 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:38.427210 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:38.427331 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:38.427763 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:38.427766 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:38.427768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:38.428029 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:38.428141 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:38.428831 (+ 690us) server_negotiation.cc:299] Negotiation successful
0619 06:38:38.429002 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260619 06:38:38.430261 15584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:38.411898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:42983 (local address 127.10.192.67:50363)
0619 06:38:38.412848 (+ 950us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:38.412900 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:38.414717 (+ 1817us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:38.415463 (+ 746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:38.415472 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:38.416101 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:38.416697 (+ 596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:38.416724 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.417811 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.417815 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:38.419096 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:38.419108 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.419984 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.419989 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:38.420178 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:38.420811 (+ 633us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:38.420832 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:38.422972 (+ 2140us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:38.426612 (+ 3640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:38.426619 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:38.426632 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:38.427100 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:38.427428 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:38.427431 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:38.427433 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:38.427607 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:38.428136 (+ 529us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:38.428141 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:38.428488 (+ 347us) client_negotiation.cc:769] Sending connection context
0619 06:38:38.428720 (+ 232us) client_negotiation.cc:240] Negotiation successful
0619 06:38:38.429129 (+ 409us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":656,"thread_start_us":419,"threads_started":1}
I20260619 06:38:38.431793 15582 heartbeater.cc:347] Connected to a master server at 127.10.192.126:42983
I20260619 06:38:38.432126 15582 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:38.432822 15582 heartbeater.cc:511] Master 127.10.192.126:42983 requested a full tablet report, sending...
I20260619 06:38:38.434283 15129 ts_manager.cc:194] Registered new tserver with Master: 1bbdb96d133e4e2c97cf143e72ae52ad (127.10.192.67:43353)
I20260619 06:38:38.435113 15129 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:50363
I20260619 06:38:38.435261 15317 heartbeater.cc:503] Master 127.10.192.126:42983 was elected leader, sending a full tablet report...
I20260619 06:38:38.437844 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 06:38:38.454735 15319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:38.442282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33660 (local address 127.10.192.126:42983)
0619 06:38:38.442505 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:38.442513 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:38.443019 (+ 506us) server_negotiation.cc:407] Connection header received
0619 06:38:38.443151 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:38.443155 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:38.443217 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:38.443349 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:38.444827 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.445537 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.446876 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.447366 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.447520 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:38.449877 (+ 2357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:38.449882 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:38.449885 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:38.449916 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:38.452374 (+ 2458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:38.452966 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:38.452969 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:38.452972 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:38.453091 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:38.453399 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:38.453403 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:38.453405 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:38.453724 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:38.453946 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:38.454217 (+ 271us) server_negotiation.cc:299] Negotiation successful
0619 06:38:38.454372 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260619 06:38:38.459208 15128 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33660:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:38:38.466194 15128 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:38:38.489758 15594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:38.477896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:40511 (local address 127.0.0.1:55438)
0619 06:38:38.478806 (+ 910us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:38.478853 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:38.479018 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:38.480281 (+ 1263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:38.480288 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:38.480318 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:38.480773 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:38.480787 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.483263 (+ 2476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.483271 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:38.486076 (+ 2805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:38.486095 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.488706 (+ 2611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.488712 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:38.488930 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:38.488995 (+ 65us) client_negotiation.cc:769] Sending connection context
0619 06:38:38.489119 (+ 124us) client_negotiation.cc:240] Negotiation successful
0619 06:38:38.489313 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":665,"thread_start_us":486,"threads_started":1}
I20260619 06:38:38.491319 15595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:38.478208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55438 (local address 127.10.192.66:40511)
0619 06:38:38.479597 (+ 1389us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:38.479604 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:38.479664 (+ 60us) server_negotiation.cc:407] Connection header received
0619 06:38:38.479776 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:38.479786 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:38.480062 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:38.481017 (+ 955us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:38.481256 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.483073 (+ 1817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.486334 (+ 3261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.488416 (+ 2082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.490392 (+ 1976us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:38.490675 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:38.490765 (+ 90us) server_negotiation.cc:299] Negotiation successful
0619 06:38:38.491000 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1225,"thread_start_us":1048,"threads_started":1}
I20260619 06:38:38.495527 15385 tablet_service.cc:1467] Processing CreateTablet for tablet d6d17c8c1f584917b2af7b4ee3acceca (DEFAULT_TABLE table=test-table [id=3cfd4a20837f4eff85b9fb3030614f58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:38.497030 15385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6d17c8c1f584917b2af7b4ee3acceca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:38.497577 15596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:38.479394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:43353 (local address 127.0.0.1:44084)
0619 06:38:38.480021 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:38.480040 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:38.480145 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:38.490440 (+ 10295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:38.490443 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:38.490464 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:38.490684 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:38.490691 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.493116 (+ 2425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.493124 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:38.494958 (+ 1834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:38.494973 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.496823 (+ 1850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.496830 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:38.497006 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:38.497047 (+ 41us) client_negotiation.cc:769] Sending connection context
0619 06:38:38.497164 (+ 117us) client_negotiation.cc:240] Negotiation successful
0619 06:38:38.497293 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"mutex_wait_us":69,"thread_start_us":387,"threads_started":1}
I20260619 06:38:38.498497 15597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:38.479822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44084 (local address 127.10.192.67:43353)
0619 06:38:38.489631 (+ 9809us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:38.489638 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:38.489666 (+ 28us) server_negotiation.cc:407] Connection header received
0619 06:38:38.489740 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:38.489746 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:38.490022 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:38.490216 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:38.490876 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.492979 (+ 2103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.495149 (+ 2170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.496627 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.496766 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:38.497009 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:38.497943 (+ 934us) server_negotiation.cc:299] Negotiation successful
0619 06:38:38.498165 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9649,"thread_start_us":9493,"threads_started":1}
I20260619 06:38:38.498924 15599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:38.480698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48480 (local address 127.10.192.65:34431)
0619 06:38:38.491318 (+ 10620us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:38.491327 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:38.491358 (+ 31us) server_negotiation.cc:407] Connection header received
0619 06:38:38.491456 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:38.491464 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:38.491743 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:38.491960 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:38.492416 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.493916 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.496488 (+ 2572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.497879 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.498051 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:38.498273 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:38.498458 (+ 185us) server_negotiation.cc:299] Negotiation successful
0619 06:38:38.498617 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10448,"thread_start_us":10293,"threads_started":1}
I20260619 06:38:38.499099 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:38.480099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34431 (local address 127.0.0.1:48480)
0619 06:38:38.488656 (+ 8557us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:38.488684 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:38.488839 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:38.491939 (+ 3100us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:38.491942 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:38.491963 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:38.492240 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:38.492247 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.494068 (+ 1821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.494074 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:38.496323 (+ 2249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:38.496337 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.498097 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.498105 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:38.498266 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:38.498302 (+ 36us) client_negotiation.cc:769] Sending connection context
0619 06:38:38.498410 (+ 108us) client_negotiation.cc:240] Negotiation successful
0619 06:38:38.498550 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8334,"mutex_wait_us":49,"thread_start_us":8847,"threads_started":1}
I20260619 06:38:38.502135 15252 tablet_service.cc:1467] Processing CreateTablet for tablet d6d17c8c1f584917b2af7b4ee3acceca (DEFAULT_TABLE table=test-table [id=3cfd4a20837f4eff85b9fb3030614f58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:38.502424 15517 tablet_service.cc:1467] Processing CreateTablet for tablet d6d17c8c1f584917b2af7b4ee3acceca (DEFAULT_TABLE table=test-table [id=3cfd4a20837f4eff85b9fb3030614f58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:38.503553 15252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6d17c8c1f584917b2af7b4ee3acceca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:38.503878 15517 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d6d17c8c1f584917b2af7b4ee3acceca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:38.512401 15600 tablet_bootstrap.cc:492] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8: Bootstrap starting.
I20260619 06:38:38.516343 15600 tablet_bootstrap.cc:654] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:38.516839 15601 tablet_bootstrap.cc:492] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe: Bootstrap starting.
I20260619 06:38:38.518080 15600 log.cc:824] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:38.520879 15601 tablet_bootstrap.cc:654] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:38.521137 15600 tablet_bootstrap.cc:492] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8: No bootstrap required, opened a new log
I20260619 06:38:38.521399 15600 ts_tablet_manager.cc:1397] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260619 06:38:38.521979 15601 log.cc:824] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:38.523245 15602 tablet_bootstrap.cc:492] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad: Bootstrap starting.
I20260619 06:38:38.525645 15601 tablet_bootstrap.cc:492] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe: No bootstrap required, opened a new log
I20260619 06:38:38.525928 15601 ts_tablet_manager.cc:1397] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260619 06:38:38.526832 15602 tablet_bootstrap.cc:654] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:38.528167 15602 log.cc:824] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:38.529251 15600 raft_consensus.cc:348] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d785b56a354323a96d237320d1f0a8" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40511 } } peers { permanent_uuid: "1bbdb96d133e4e2c97cf143e72ae52ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43353 } } peers { permanent_uuid: "96ba0475f7ca4ae1904b4dddb75a9efe" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34431 } }
I20260619 06:38:38.529747 15600 raft_consensus.cc:374] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:38.529851 15600 raft_consensus.cc:729] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9d785b56a354323a96d237320d1f0a8, State: Initialized, Role: FOLLOWER
I20260619 06:38:38.530480 15600 consensus_queue.cc:260] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d785b56a354323a96d237320d1f0a8" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40511 } } peers { permanent_uuid: "1bbdb96d133e4e2c97cf143e72ae52ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43353 } } peers { permanent_uuid: "96ba0475f7ca4ae1904b4dddb75a9efe" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34431 } }
I20260619 06:38:38.531490 15602 tablet_bootstrap.cc:492] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad: No bootstrap required, opened a new log
I20260619 06:38:38.531566 15450 heartbeater.cc:503] Master 127.10.192.126:42983 was elected leader, sending a full tablet report...
I20260619 06:38:38.531885 15602 ts_tablet_manager.cc:1397] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.000s
I20260619 06:38:38.532310 15600 ts_tablet_manager.cc:1428] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8: Time spent starting tablet: real 0.011s user 0.008s sys 0.004s
I20260619 06:38:38.536445 15601 raft_consensus.cc:348] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d785b56a354323a96d237320d1f0a8" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40511 } } peers { permanent_uuid: "1bbdb96d133e4e2c97cf143e72ae52ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43353 } } peers { permanent_uuid: "96ba0475f7ca4ae1904b4dddb75a9efe" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34431 } }
I20260619 06:38:38.536947 15601 raft_consensus.cc:374] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:38.537060 15601 raft_consensus.cc:729] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96ba0475f7ca4ae1904b4dddb75a9efe, State: Initialized, Role: FOLLOWER
I20260619 06:38:38.537714 15601 consensus_queue.cc:260] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d785b56a354323a96d237320d1f0a8" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40511 } } peers { permanent_uuid: "1bbdb96d133e4e2c97cf143e72ae52ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43353 } } peers { permanent_uuid: "96ba0475f7ca4ae1904b4dddb75a9efe" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34431 } }
I20260619 06:38:38.539544 15601 ts_tablet_manager.cc:1428] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe: Time spent starting tablet: real 0.013s user 0.009s sys 0.005s
I20260619 06:38:38.542088 15602 raft_consensus.cc:348] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d785b56a354323a96d237320d1f0a8" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40511 } } peers { permanent_uuid: "1bbdb96d133e4e2c97cf143e72ae52ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43353 } } peers { permanent_uuid: "96ba0475f7ca4ae1904b4dddb75a9efe" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34431 } }
I20260619 06:38:38.542574 15602 raft_consensus.cc:374] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:38.542655 15602 raft_consensus.cc:729] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bbdb96d133e4e2c97cf143e72ae52ad, State: Initialized, Role: FOLLOWER
I20260619 06:38:38.543310 15602 consensus_queue.cc:260] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d785b56a354323a96d237320d1f0a8" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40511 } } peers { permanent_uuid: "1bbdb96d133e4e2c97cf143e72ae52ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43353 } } peers { permanent_uuid: "96ba0475f7ca4ae1904b4dddb75a9efe" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34431 } }
I20260619 06:38:38.544377 15582 heartbeater.cc:503] Master 127.10.192.126:42983 was elected leader, sending a full tablet report...
I20260619 06:38:38.545076 15602 ts_tablet_manager.cc:1428] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
I20260619 06:38:38.638947 15607 raft_consensus.cc:482] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:38:38.639218 15607 raft_consensus.cc:504] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d785b56a354323a96d237320d1f0a8" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40511 } } peers { permanent_uuid: "1bbdb96d133e4e2c97cf143e72ae52ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43353 } } peers { permanent_uuid: "96ba0475f7ca4ae1904b4dddb75a9efe" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34431 } }
I20260619 06:38:38.641086 15607 leader_election.cc:288] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a9d785b56a354323a96d237320d1f0a8 (127.10.192.66:40511), 1bbdb96d133e4e2c97cf143e72ae52ad (127.10.192.67:43353)
I20260619 06:38:38.648319 15595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:38.641471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:48855 (local address 127.10.192.66:40511)
0619 06:38:38.641713 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:38.641723 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:38.642209 (+ 486us) server_negotiation.cc:407] Connection header received
0619 06:38:38.642474 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:38.642483 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:38.642588 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:38.642708 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:38.643393 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.644538 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.646338 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.647254 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.647446 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:38.647521 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:38.647937 (+ 416us) server_negotiation.cc:299] Negotiation successful
0619 06:38:38.648057 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 06:38:38.648358 15597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:38.642429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:60071 (local address 127.10.192.67:43353)
0619 06:38:38.642676 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:38.642683 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:38.643072 (+ 389us) server_negotiation.cc:407] Connection header received
0619 06:38:38.643277 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:38.643281 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:38.643378 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:38.643469 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:38.643962 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.644883 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.646592 (+ 1709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.647387 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.647560 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:38.647638 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:38.647983 (+ 345us) server_negotiation.cc:299] Negotiation successful
0619 06:38:38.648104 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260619 06:38:38.648483 15609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:38.641450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:40511 (local address 127.10.192.65:48855)
0619 06:38:38.642098 (+ 648us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:38.642114 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:38.642292 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:38.642876 (+ 584us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:38.642880 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:38.642900 (+ 20us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:38.643254 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:38.643262 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.644661 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.644664 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:38.646179 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:38.646191 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.647461 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.647467 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:38.647770 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:38.647795 (+ 25us) client_negotiation.cc:769] Sending connection context
0619 06:38:38.647898 (+ 103us) client_negotiation.cc:240] Negotiation successful
0619 06:38:38.648034 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":374,"threads_started":1}
I20260619 06:38:38.648553 15610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:38.642269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:43353 (local address 127.10.192.65:60071)
0619 06:38:38.642964 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:38.642981 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:38.643132 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:38.643486 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:38.643489 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:38.643507 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:38.643821 (+ 314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:38.643828 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.645021 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.645026 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:38.646433 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:38.646444 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.647610 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.647617 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:38.647827 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:38.647850 (+ 23us) client_negotiation.cc:769] Sending connection context
0619 06:38:38.647958 (+ 108us) client_negotiation.cc:240] Negotiation successful
0619 06:38:38.648082 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":602,"mutex_wait_us":4,"thread_start_us":419,"threads_started":1}
I20260619 06:38:38.649748 15405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6d17c8c1f584917b2af7b4ee3acceca" candidate_uuid: "96ba0475f7ca4ae1904b4dddb75a9efe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d785b56a354323a96d237320d1f0a8" is_pre_election: true
I20260619 06:38:38.649711 15537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6d17c8c1f584917b2af7b4ee3acceca" candidate_uuid: "96ba0475f7ca4ae1904b4dddb75a9efe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bbdb96d133e4e2c97cf143e72ae52ad" is_pre_election: true
I20260619 06:38:38.650308 15405 raft_consensus.cc:2454] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96ba0475f7ca4ae1904b4dddb75a9efe in term 0.
I20260619 06:38:38.650308 15537 raft_consensus.cc:2454] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96ba0475f7ca4ae1904b4dddb75a9efe in term 0.
I20260619 06:38:38.650985 15207 leader_election.cc:302] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bbdb96d133e4e2c97cf143e72ae52ad, 96ba0475f7ca4ae1904b4dddb75a9efe; no voters:
I20260619 06:38:38.651306 15607 raft_consensus.cc:2781] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:38:38.651494 15607 raft_consensus.cc:482] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:38:38.651607 15607 raft_consensus.cc:3037] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [term 0 FOLLOWER]: Advancing to term 1
W20260619 06:38:38.653709 15318 tablet.cc:2369] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:38:38.653970 15607 raft_consensus.cc:504] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d785b56a354323a96d237320d1f0a8" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40511 } } peers { permanent_uuid: "1bbdb96d133e4e2c97cf143e72ae52ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43353 } } peers { permanent_uuid: "96ba0475f7ca4ae1904b4dddb75a9efe" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34431 } }
I20260619 06:38:38.654677 15607 leader_election.cc:288] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [CANDIDATE]: Term 1 election: Requested vote from peers a9d785b56a354323a96d237320d1f0a8 (127.10.192.66:40511), 1bbdb96d133e4e2c97cf143e72ae52ad (127.10.192.67:43353)
I20260619 06:38:38.655138 15405 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6d17c8c1f584917b2af7b4ee3acceca" candidate_uuid: "96ba0475f7ca4ae1904b4dddb75a9efe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9d785b56a354323a96d237320d1f0a8"
I20260619 06:38:38.655333 15405 raft_consensus.cc:3037] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:38.655406 15537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6d17c8c1f584917b2af7b4ee3acceca" candidate_uuid: "96ba0475f7ca4ae1904b4dddb75a9efe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bbdb96d133e4e2c97cf143e72ae52ad"
I20260619 06:38:38.655694 15537 raft_consensus.cc:3037] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:38.657899 15405 raft_consensus.cc:2454] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96ba0475f7ca4ae1904b4dddb75a9efe in term 1.
I20260619 06:38:38.658180 15537 raft_consensus.cc:2454] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96ba0475f7ca4ae1904b4dddb75a9efe in term 1.
I20260619 06:38:38.658325 15207 leader_election.cc:302] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96ba0475f7ca4ae1904b4dddb75a9efe, a9d785b56a354323a96d237320d1f0a8; no voters:
I20260619 06:38:38.658638 15607 raft_consensus.cc:2781] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:38.659080 15607 raft_consensus.cc:686] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [term 1 LEADER]: Becoming Leader. State: Replica: 96ba0475f7ca4ae1904b4dddb75a9efe, State: Running, Role: LEADER
W20260619 06:38:38.659446 15451 tablet.cc:2369] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:38:38.659689 15607 consensus_queue.cc:237] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d785b56a354323a96d237320d1f0a8" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40511 } } peers { permanent_uuid: "1bbdb96d133e4e2c97cf143e72ae52ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43353 } } peers { permanent_uuid: "96ba0475f7ca4ae1904b4dddb75a9efe" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34431 } }
W20260619 06:38:38.660086 15583 tablet.cc:2369] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:38:38.664899 15129 catalog_manager.cc:5495] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe reported cstate change: term changed from 0 to 1, leader changed from <none> to 96ba0475f7ca4ae1904b4dddb75a9efe (127.10.192.65). New cstate: current_term: 1 leader_uuid: "96ba0475f7ca4ae1904b4dddb75a9efe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a9d785b56a354323a96d237320d1f0a8" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bbdb96d133e4e2c97cf143e72ae52ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "96ba0475f7ca4ae1904b4dddb75a9efe" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34431 } health_report { overall_health: HEALTHY } } }
I20260619 06:38:38.686563 15599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:38.680640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48496 (local address 127.10.192.65:34431)
0619 06:38:38.680932 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:38.680939 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:38.681060 (+ 121us) server_negotiation.cc:407] Connection header received
0619 06:38:38.681354 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:38.681359 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:38.681442 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:38.681616 (+ 174us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:38:38.682029 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.682788 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.684288 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.684729 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.684880 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:38.685395 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:38:38.685916 (+ 521us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:38:38.686101 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:38.686163 (+ 62us) server_negotiation.cc:299] Negotiation successful
0619 06:38:38.686251 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260619 06:38:38.695009 15537 raft_consensus.cc:1261] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad [term 1 FOLLOWER]: Refusing update from remote peer 96ba0475f7ca4ae1904b4dddb75a9efe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:38.695009 15405 raft_consensus.cc:1261] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8 [term 1 FOLLOWER]: Refusing update from remote peer 96ba0475f7ca4ae1904b4dddb75a9efe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:38.696103 15611 consensus_queue.cc:1035] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bbdb96d133e4e2c97cf143e72ae52ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:38.696483 15607 consensus_queue.cc:1035] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9d785b56a354323a96d237320d1f0a8" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:38.719141 15614 mvcc.cc:205] Tried to move back new op lower bound from 7298462182164008960 to 7298462182035279872. Current Snapshot: MvccSnapshot[applied={T|T < 7298462182164008960}]
I20260619 06:38:38.720391 15616 mvcc.cc:205] Tried to move back new op lower bound from 7298462182164008960 to 7298462182035279872. Current Snapshot: MvccSnapshot[applied={T|T < 7298462182164008960}]
I20260619 06:38:38.733551 15129 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:38:38.733848 15129 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:38:38.737488 15129 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 656a466aa0ca4aa4ad5b50caefb65ce9: Sending DeleteTablet for 3 replicas of tablet d6d17c8c1f584917b2af7b4ee3acceca
I20260619 06:38:38.738665 15385 tablet_service.cc:1514] Processing DeleteTablet for tablet d6d17c8c1f584917b2af7b4ee3acceca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:38 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:55438
I20260619 06:38:38.738819 15517 tablet_service.cc:1514] Processing DeleteTablet for tablet d6d17c8c1f584917b2af7b4ee3acceca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:38 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:44084
I20260619 06:38:38.739073 15252 tablet_service.cc:1514] Processing DeleteTablet for tablet d6d17c8c1f584917b2af7b4ee3acceca with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:38 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:48480
I20260619 06:38:38.741710 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 15190
I20260619 06:38:38.744253 15626 tablet_replica.cc:330] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe: stopping tablet replica
I20260619 06:38:38.744773 15626 raft_consensus.cc:2229] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:38:38.745018 15624 tablet_replica.cc:330] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8: stopping tablet replica
I20260619 06:38:38.745443 15626 raft_consensus.cc:2258] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:38.745435 15624 raft_consensus.cc:2229] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:38.746083 15624 raft_consensus.cc:2258] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:38.748901 15624 ts_tablet_manager.cc:1905] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:38.750104 15626 ts_tablet_manager.cc:1905] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe: Deleting tablet data with delete state TABLET_DATA_DELETED
Jun 19 06:38:38 dist-test-slave-7lz4 krb5kdc[15085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:38:38.757944 15625 tablet_replica.cc:330] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad: stopping tablet replica
I20260619 06:38:38.758281 15624 ts_tablet_manager.cc:1918] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:38:38.758431 15624 log.cc:1196] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/d6d17c8c1f584917b2af7b4ee3acceca
I20260619 06:38:38.758486 15625 raft_consensus.cc:2229] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:38.759008 15624 ts_tablet_manager.cc:1939] T d6d17c8c1f584917b2af7b4ee3acceca P a9d785b56a354323a96d237320d1f0a8: Deleting consensus metadata
I20260619 06:38:38.759361 15625 raft_consensus.cc:2258] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:38.761199 15115 catalog_manager.cc:4841] TS a9d785b56a354323a96d237320d1f0a8 (127.10.192.66:40511): tablet d6d17c8c1f584917b2af7b4ee3acceca (table test-table [id=3cfd4a20837f4eff85b9fb3030614f58]) successfully deleted
I20260619 06:38:38.761498 15625 ts_tablet_manager.cc:1905] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:38.764550 15599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:38.744033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48508 (local address 127.10.192.65:34431)
0619 06:38:38.744200 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:38.744207 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:38.745153 (+ 946us) server_negotiation.cc:407] Connection header received
0619 06:38:38.745219 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:38.745223 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:38.745313 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:38.745444 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:38.747285 (+ 1841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.748413 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.750356 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.751050 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.751147 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:38.756519 (+ 5372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:38.756533 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:38.756551 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:38.756603 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:38.760695 (+ 4092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:38.761789 (+ 1094us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:38.761798 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:38.761802 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:38.762001 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:38.762481 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:38.762486 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:38.762489 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:38.762965 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:38.763279 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:38.763921 (+ 642us) server_negotiation.cc:299] Negotiation successful
0619 06:38:38.764163 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260619 06:38:38.765446 15626 ts_tablet_manager.cc:1918] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:38:38.765628 15626 log.cc:1196] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/d6d17c8c1f584917b2af7b4ee3acceca
I20260619 06:38:38.766388 15312 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:38.770045 15625 ts_tablet_manager.cc:1918] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:38:38.770628 15625 log.cc:1196] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/d6d17c8c1f584917b2af7b4ee3acceca
I20260619 06:38:38.771083 15625 ts_tablet_manager.cc:1939] T d6d17c8c1f584917b2af7b4ee3acceca P 1bbdb96d133e4e2c97cf143e72ae52ad: Deleting consensus metadata
I20260619 06:38:38.772670 15115 catalog_manager.cc:4841] TS 1bbdb96d133e4e2c97cf143e72ae52ad (127.10.192.67:43353): tablet d6d17c8c1f584917b2af7b4ee3acceca (table test-table [id=3cfd4a20837f4eff85b9fb3030614f58]) successfully deleted
I20260619 06:38:38.865067 15626 ts_tablet_manager.cc:1939] T d6d17c8c1f584917b2af7b4ee3acceca P 96ba0475f7ca4ae1904b4dddb75a9efe: Deleting consensus metadata
I20260619 06:38:38.865993 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 15190
I20260619 06:38:38.883087 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 15323
W20260619 06:38:38.883106 15115 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.192.65:34431 (error 108)
I20260619 06:38:38.885039 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:38.884627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34431 (local address 127.0.0.1:48510)
0619 06:38:38.884791 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:38.884898 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:34431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260619 06:38:38.885262 15115 catalog_manager.cc:4584] TS 96ba0475f7ca4ae1904b4dddb75a9efe (127.10.192.65:34431): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d6d17c8c1f584917b2af7b4ee3acceca: Network error: Client connection negotiation failed: client connection to 127.10.192.65:34431: connect: Connection refused (error 111)
Jun 19 06:38:38 dist-test-slave-7lz4 krb5kdc[15085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.66@KRBTEST.COM
I20260619 06:38:38.898983 15595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:38.883996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55452 (local address 127.10.192.66:40511)
0619 06:38:38.884183 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:38.884189 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:38.884438 (+ 249us) server_negotiation.cc:407] Connection header received
0619 06:38:38.884676 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:38.884689 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:38.884765 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:38.884884 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:38.886254 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.887013 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.888419 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:38.888811 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:38.888951 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:38.893102 (+ 4151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:38.893117 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:38.893134 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:38.893172 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:38.895994 (+ 2822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:38.896769 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:38.896778 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:38.896780 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:38.896933 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:38.897390 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:38.897398 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:38.897406 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:38.897764 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:38.898117 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:38.898397 (+ 280us) server_negotiation.cc:299] Negotiation successful
0619 06:38:38.898633 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260619 06:38:38.899718 15445 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:38.938977 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:38.938473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34431 (local address 127.0.0.1:48518)
0619 06:38:38.938699 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:38.938816 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:34431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
I20260619 06:38:38.940053 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:38.939712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34431 (local address 127.0.0.1:48534)
0619 06:38:38.939855 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:38.939945 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:34431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260619 06:38:38.989500 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 15323
I20260619 06:38:39.000747 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:39.000308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34431 (local address 127.0.0.1:48536)
0619 06:38:39.000512 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:39.000599 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:34431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260619 06:38:39.001762 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:39.001463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34431 (local address 127.0.0.1:48552)
0619 06:38:39.001589 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:39.001655 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:34431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260619 06:38:39.008324 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 15455
Jun 19 06:38:39 dist-test-slave-7lz4 krb5kdc[15085](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.67@KRBTEST.COM
I20260619 06:38:39.023073 15597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:39.009124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44096 (local address 127.10.192.67:43353)
0619 06:38:39.009324 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:39.009332 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:39.009358 (+ 26us) server_negotiation.cc:407] Connection header received
0619 06:38:39.009597 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:39.009601 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:39.009678 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:39.009788 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:39.011066 (+ 1278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:39.011868 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:39.013175 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:39.013557 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:39.013693 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:39.017931 (+ 4238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:39.017946 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:39.017964 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:39.018000 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:39.020674 (+ 2674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:39.021335 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:39.021342 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:39.021344 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:39.021496 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:39.021842 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:39.021845 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:39.021847 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:39.022186 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:39.022420 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:39.022673 (+ 253us) server_negotiation.cc:299] Negotiation successful
0619 06:38:39.022832 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 06:38:39.023756 15577 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:39.082594 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:39.082090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34431 (local address 127.0.0.1:48558)
0619 06:38:39.082309 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:39.082407 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:34431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260619 06:38:39.083709 15598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:39.083270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34431 (local address 127.0.0.1:48574)
0619 06:38:39.083467 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:39.083538 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:34431: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260619 06:38:39.114408 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 15455
I20260619 06:38:39.130991 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 15098
I20260619 06:38:39.132231 15159 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:39.240712 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 15098
2026-06-19T06:38:39Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (4178 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-06-19T06:38:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:38:39Z Disabled control of system clock
I20260619 06:38:39.307153 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:38685
--webserver_interface=127.10.192.126
--webserver_port=0
--builtin_ntp_servers=127.10.192.84:39323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:38685
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260619 06:38:39.633421 15636 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:39.633720 15636 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:39.633808 15636 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:39.641227 15636 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:38:39.641351 15636 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:39.641389 15636 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:39.641439 15636 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:38:39.641484 15636 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:38:39.650931 15636 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:39323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:38685
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:38685
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:39.652257 15636 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:39.654091 15636 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:39.665963 15644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:39.666050 15642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:39.666155 15641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:39.667363 15636 server_base.cc:1034] running on GCE node
I20260619 06:38:39.668246 15636 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:39.669663 15636 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:39.670890 15636 hybrid_clock.cc:648] HybridClock initialized: now 1781851119670833 us; error 55 us; skew 500 ppm
I20260619 06:38:39.671238 15636 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:38:39.673543 15636 webserver.cc:460] Webserver started at http://127.10.192.126:40719/ using document root <none> and password file <none>
I20260619 06:38:39.674252 15636 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:39.674382 15636 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:39.674705 15636 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:39.677708 15636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "b476036539e443bfae8d854e8ab8cffd"
format_stamp: "Formatted at 2026-06-19 06:38:39 on dist-test-slave-7lz4"
server_key: "0cc02a201343de35f7e1ca62296a873f"
server_key_iv: "830a9bb2d1c3e43a68f0b3e991ecb909"
server_key_version: "encryptionkey@0"
I20260619 06:38:39.678568 15636 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "b476036539e443bfae8d854e8ab8cffd"
format_stamp: "Formatted at 2026-06-19 06:38:39 on dist-test-slave-7lz4"
server_key: "0cc02a201343de35f7e1ca62296a873f"
server_key_iv: "830a9bb2d1c3e43a68f0b3e991ecb909"
server_key_version: "encryptionkey@0"
I20260619 06:38:39.683902 15636 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260619 06:38:39.687273 15650 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:39.688692 15636 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:38:39.688874 15636 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "b476036539e443bfae8d854e8ab8cffd"
format_stamp: "Formatted at 2026-06-19 06:38:39 on dist-test-slave-7lz4"
server_key: "0cc02a201343de35f7e1ca62296a873f"
server_key_iv: "830a9bb2d1c3e43a68f0b3e991ecb909"
server_key_version: "encryptionkey@0"
I20260619 06:38:39.689105 15636 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:39.694777 15636 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:39.695549 15636 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:39.695874 15636 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:39.714581 15636 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:38685
I20260619 06:38:39.714588 15701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:38685 every 8 connection(s)
I20260619 06:38:39.716086 15636 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:38:39.716563 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 15636
I20260619 06:38:39.716741 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:38:39.717593 11009 external_mini_cluster.cc:1428] Setting key 26ea000a3969f41fddcbe0480340ad15
I20260619 06:38:39.720651 15702 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:39.726126 15705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:39.719757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54354 (local address 127.10.192.126:38685)
0619 06:38:39.720799 (+ 1042us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:39.720812 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:39.720854 (+ 42us) server_negotiation.cc:407] Connection header received
0619 06:38:39.722403 (+ 1549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:39.722423 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:39.722831 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:39.723252 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:39.724390 (+ 1138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:39.724396 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:39.724408 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:38:39.724422 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:39.724512 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:38:39.724528 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:39.724773 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:39.724938 (+ 165us) server_negotiation.cc:299] Negotiation successful
0619 06:38:39.725198 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":354,"threads_started":1}
I20260619 06:38:39.732486 15702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd: Bootstrap starting.
I20260619 06:38:39.735379 15702 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:39.736449 15702 log.cc:824] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:39.739308 15702 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd: No bootstrap required, opened a new log
I20260619 06:38:39.746658 15702 raft_consensus.cc:348] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b476036539e443bfae8d854e8ab8cffd" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 38685 } }
I20260619 06:38:39.747030 15702 raft_consensus.cc:374] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:39.747157 15702 raft_consensus.cc:729] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b476036539e443bfae8d854e8ab8cffd, State: Initialized, Role: FOLLOWER
I20260619 06:38:39.747850 15702 consensus_queue.cc:260] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b476036539e443bfae8d854e8ab8cffd" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 38685 } }
I20260619 06:38:39.748091 15702 raft_consensus.cc:388] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:38:39.748220 15702 raft_consensus.cc:482] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:38:39.748402 15702 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:39.750524 15702 raft_consensus.cc:504] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b476036539e443bfae8d854e8ab8cffd" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 38685 } }
I20260619 06:38:39.751025 15702 leader_election.cc:302] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b476036539e443bfae8d854e8ab8cffd; no voters:
I20260619 06:38:39.751621 15702 leader_election.cc:288] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:38:39.751756 15707 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:39.752691 15707 raft_consensus.cc:686] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd [term 1 LEADER]: Becoming Leader. State: Replica: b476036539e443bfae8d854e8ab8cffd, State: Running, Role: LEADER
I20260619 06:38:39.753283 15707 consensus_queue.cc:237] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b476036539e443bfae8d854e8ab8cffd" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 38685 } }
I20260619 06:38:39.754170 15702 sys_catalog.cc:564] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:38:39.756597 15708 sys_catalog.cc:455] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b476036539e443bfae8d854e8ab8cffd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b476036539e443bfae8d854e8ab8cffd" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 38685 } } }
I20260619 06:38:39.757054 15708 sys_catalog.cc:458] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:39.757758 15709 sys_catalog.cc:455] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd [sys.catalog]: SysCatalogTable state changed. Reason: New leader b476036539e443bfae8d854e8ab8cffd. Latest consensus state: current_term: 1 leader_uuid: "b476036539e443bfae8d854e8ab8cffd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b476036539e443bfae8d854e8ab8cffd" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 38685 } } }
I20260619 06:38:39.758165 15709 sys_catalog.cc:458] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:39.758515 15716 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:38:39.764801 15716 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:38:39.773756 15716 catalog_manager.cc:1347] Generated new cluster ID: f2958303af484257bb576eac28caeac5
I20260619 06:38:39.773882 15716 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:38:39.782951 15716 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:38:39.783478 15716 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:38:39.793965 15716 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd: Generated new TSK 0
I20260619 06:38:39.795125 15716 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:38:39.811898 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:38685
--builtin_ntp_servers=127.10.192.84:39323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260619 06:38:40.145117 15726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:40.145416 15726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:40.145603 15726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:40.152880 15726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:40.152994 15726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:40.153187 15726 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:38:40.162731 15726 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:39323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:38685
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:40.164112 15726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:40.165983 15726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:40.179169 15731 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:40.179271 15732 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:40.179209 15734 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:40.180347 15726 server_base.cc:1034] running on GCE node
I20260619 06:38:40.181010 15726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:40.182013 15726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:40.183218 15726 hybrid_clock.cc:648] HybridClock initialized: now 1781851120183167 us; error 43 us; skew 500 ppm
I20260619 06:38:40.183559 15726 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:38:40.185935 15726 webserver.cc:460] Webserver started at http://127.10.192.65:45963/ using document root <none> and password file <none>
I20260619 06:38:40.186690 15726 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:40.186803 15726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:40.187155 15726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:40.190095 15726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "84e47074cae541aa9cd82039ee7ad1dc"
format_stamp: "Formatted at 2026-06-19 06:38:40 on dist-test-slave-7lz4"
server_key: "c8ed77f195eb01332d32e387a5e3335b"
server_key_iv: "b5500211ad4bb0adc89f9cc8cf6d2383"
server_key_version: "encryptionkey@0"
I20260619 06:38:40.190991 15726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "84e47074cae541aa9cd82039ee7ad1dc"
format_stamp: "Formatted at 2026-06-19 06:38:40 on dist-test-slave-7lz4"
server_key: "c8ed77f195eb01332d32e387a5e3335b"
server_key_iv: "b5500211ad4bb0adc89f9cc8cf6d2383"
server_key_version: "encryptionkey@0"
I20260619 06:38:40.196650 15726 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260619 06:38:40.200326 15740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:40.201748 15726 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:38:40.201889 15726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "84e47074cae541aa9cd82039ee7ad1dc"
format_stamp: "Formatted at 2026-06-19 06:38:40 on dist-test-slave-7lz4"
server_key: "c8ed77f195eb01332d32e387a5e3335b"
server_key_iv: "b5500211ad4bb0adc89f9cc8cf6d2383"
server_key_version: "encryptionkey@0"
I20260619 06:38:40.202077 15726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:40.207916 15726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:40.208678 15726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:40.208896 15726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:40.209736 15726 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:40.211050 15726 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:40.211133 15726 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:40.211213 15726 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:40.211267 15726 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:40.245085 15726 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:44015
I20260619 06:38:40.245139 15852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:44015 every 8 connection(s)
I20260619 06:38:40.246467 15726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:38:40.251230 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 15726
I20260619 06:38:40.251431 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:38:40.252101 11009 external_mini_cluster.cc:1428] Setting key e2c75ddbbfc12b190718c9ad8fc91971
I20260619 06:38:40.254740 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:38685
--builtin_ntp_servers=127.10.192.84:39323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260619 06:38:40.255174 15855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:40.249206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:56495 (local address 127.10.192.126:38685)
0619 06:38:40.249662 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:40.249667 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:40.250758 (+ 1091us) server_negotiation.cc:407] Connection header received
0619 06:38:40.252654 (+ 1896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:40.252660 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:40.252736 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:40.252856 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:40.254340 (+ 1484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:40.254353 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:40.254357 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:38:40.254372 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:40.254413 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:38:40.254461 (+ 48us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:40.254577 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:40.254779 (+ 202us) server_negotiation.cc:299] Negotiation successful
0619 06:38:40.254845 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":350,"thread_start_us":249,"threads_started":1}
I20260619 06:38:40.256299 15856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:40.249691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:38685 (local address 127.10.192.65:56495)
0619 06:38:40.250587 (+ 896us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:40.250633 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:40.252373 (+ 1740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:40.253120 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:40.253129 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:40.253232 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:40.253998 (+ 766us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:38:40.254000 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:40.254038 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:38:40.254176 (+ 138us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:40.254548 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:40.254559 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:40.254566 (+ 7us) client_negotiation.cc:769] Sending connection context
0619 06:38:40.254868 (+ 302us) client_negotiation.cc:240] Negotiation successful
0619 06:38:40.255141 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":268,"threads_started":1}
I20260619 06:38:40.257977 15853 heartbeater.cc:347] Connected to a master server at 127.10.192.126:38685
I20260619 06:38:40.258328 15853 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:40.258939 15853 heartbeater.cc:511] Master 127.10.192.126:38685 requested a full tablet report, sending...
I20260619 06:38:40.261080 15667 ts_manager.cc:194] Registered new tserver with Master: 84e47074cae541aa9cd82039ee7ad1dc (127.10.192.65:44015)
W20260619 06:38:40.585244 15857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:40.585534 15857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:40.585623 15857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:40.593252 15857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:40.593406 15857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:40.593560 15857 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:38:40.602981 15857 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:39323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:38685
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:40.604387 15857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:40.606142 15857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:40.619570 15862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:40.619678 15863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:40.619611 15865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:40.620671 15857 server_base.cc:1034] running on GCE node
I20260619 06:38:40.621302 15857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:40.623306 15857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:40.624536 15857 hybrid_clock.cc:648] HybridClock initialized: now 1781851120624482 us; error 50 us; skew 500 ppm
I20260619 06:38:40.624881 15857 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:38:40.627276 15857 webserver.cc:460] Webserver started at http://127.10.192.66:34733/ using document root <none> and password file <none>
I20260619 06:38:40.628098 15857 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:40.628233 15857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:40.628572 15857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:40.631500 15857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "5757686b01094e05aa4b19f282940110"
format_stamp: "Formatted at 2026-06-19 06:38:40 on dist-test-slave-7lz4"
server_key: "d9f65b6b921e907054c968463745f445"
server_key_iv: "3dd683c4b7f13bc988263b0c055e0d71"
server_key_version: "encryptionkey@0"
I20260619 06:38:40.632398 15857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "5757686b01094e05aa4b19f282940110"
format_stamp: "Formatted at 2026-06-19 06:38:40 on dist-test-slave-7lz4"
server_key: "d9f65b6b921e907054c968463745f445"
server_key_iv: "3dd683c4b7f13bc988263b0c055e0d71"
server_key_version: "encryptionkey@0"
I20260619 06:38:40.637600 15857 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260619 06:38:40.641307 15871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:40.642697 15857 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 06:38:40.642881 15857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "5757686b01094e05aa4b19f282940110"
format_stamp: "Formatted at 2026-06-19 06:38:40 on dist-test-slave-7lz4"
server_key: "d9f65b6b921e907054c968463745f445"
server_key_iv: "3dd683c4b7f13bc988263b0c055e0d71"
server_key_version: "encryptionkey@0"
I20260619 06:38:40.643122 15857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:40.649168 15857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:40.650038 15857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:40.650331 15857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:40.651292 15857 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:40.652765 15857 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:40.652887 15857 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:40.653036 15857 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:40.653126 15857 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:40.686399 15857 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:33845
I20260619 06:38:40.686461 15983 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:33845 every 8 connection(s)
I20260619 06:38:40.687839 15857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:38:40.696071 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 15857
I20260619 06:38:40.696238 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:38:40.696270 15855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:40.690547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:45793 (local address 127.10.192.126:38685)
0619 06:38:40.690771 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:40.690777 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:40.692285 (+ 1508us) server_negotiation.cc:407] Connection header received
0619 06:38:40.693960 (+ 1675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:40.693965 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:40.694032 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:40.694121 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:40.695438 (+ 1317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:40.695444 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:40.695447 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:38:40.695466 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:40.695498 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:38:40.695510 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:40.695635 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:40.695868 (+ 233us) server_negotiation.cc:299] Negotiation successful
0619 06:38:40.695947 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260619 06:38:40.696743 11009 external_mini_cluster.cc:1428] Setting key f3dc7141b834ba5a7ee3426c1d6fde6f
I20260619 06:38:40.697217 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:40.691141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:38685 (local address 127.10.192.66:45793)
0619 06:38:40.692126 (+ 985us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:40.692164 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:40.693696 (+ 1532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:40.694383 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:40.694395 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:40.694499 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:40.695136 (+ 637us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:38:40.695138 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:40.695180 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:38:40.695270 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:40.695596 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:40.695602 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:40.695608 (+ 6us) client_negotiation.cc:769] Sending connection context
0619 06:38:40.695911 (+ 303us) client_negotiation.cc:240] Negotiation successful
0619 06:38:40.696116 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":278,"threads_started":1}
I20260619 06:38:40.698648 15984 heartbeater.cc:347] Connected to a master server at 127.10.192.126:38685
I20260619 06:38:40.699007 15984 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:40.699780 15984 heartbeater.cc:511] Master 127.10.192.126:38685 requested a full tablet report, sending...
I20260619 06:38:40.699921 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:38685
--builtin_ntp_servers=127.10.192.84:39323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260619 06:38:40.701490 15667 ts_manager.cc:194] Registered new tserver with Master: 5757686b01094e05aa4b19f282940110 (127.10.192.66:33845)
W20260619 06:38:41.072021 15987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:41.072319 15987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:41.072507 15987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:41.079752 15987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:41.079891 15987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:41.080052 15987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:38:41.089299 15987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:39323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:38685
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:41.090668 15987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:41.092559 15987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:41.106176 15995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:41.106201 15993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:41.106130 15992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:41.112282 15987 server_base.cc:1034] running on GCE node
I20260619 06:38:41.113041 15987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:41.114033 15987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:41.115235 15987 hybrid_clock.cc:648] HybridClock initialized: now 1781851121115191 us; error 37 us; skew 500 ppm
I20260619 06:38:41.115532 15987 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:38:41.117902 15987 webserver.cc:460] Webserver started at http://127.10.192.67:35795/ using document root <none> and password file <none>
I20260619 06:38:41.118610 15987 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:41.118697 15987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:41.118979 15987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:41.121887 15987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "f3357519f6df48a3a8fcab2e782f31e7"
format_stamp: "Formatted at 2026-06-19 06:38:41 on dist-test-slave-7lz4"
server_key: "2d003007df12a294955b2ca53b197917"
server_key_iv: "4416750c6cc43b32567d5e698088a24f"
server_key_version: "encryptionkey@0"
I20260619 06:38:41.122633 15987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "f3357519f6df48a3a8fcab2e782f31e7"
format_stamp: "Formatted at 2026-06-19 06:38:41 on dist-test-slave-7lz4"
server_key: "2d003007df12a294955b2ca53b197917"
server_key_iv: "4416750c6cc43b32567d5e698088a24f"
server_key_version: "encryptionkey@0"
I20260619 06:38:41.128062 15987 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 06:38:41.131525 16001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:41.132959 15987 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:38:41.133142 15987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "f3357519f6df48a3a8fcab2e782f31e7"
format_stamp: "Formatted at 2026-06-19 06:38:41 on dist-test-slave-7lz4"
server_key: "2d003007df12a294955b2ca53b197917"
server_key_iv: "4416750c6cc43b32567d5e698088a24f"
server_key_version: "encryptionkey@0"
I20260619 06:38:41.133364 15987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:41.139273 15987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:41.140195 15987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:41.140473 15987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:41.141391 15987 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:41.142911 15987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:41.143031 15987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:41.143164 15987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:41.143251 15987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:41.176893 15987 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:36789
I20260619 06:38:41.176985 16113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:36789 every 8 connection(s)
I20260619 06:38:41.178251 15987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:38:41.186200 15855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.180841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:44077 (local address 127.10.192.126:38685)
0619 06:38:41.181028 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:41.181033 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:41.182522 (+ 1489us) server_negotiation.cc:407] Connection header received
0619 06:38:41.184177 (+ 1655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:41.184181 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:41.184233 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:41.184320 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:41.185578 (+ 1258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:41.185582 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:41.185585 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:38:41.185602 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:41.185634 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:38:41.185646 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:41.185752 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:41.185943 (+ 191us) server_negotiation.cc:299] Negotiation successful
0619 06:38:41.185994 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260619 06:38:41.187160 16116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.181386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:38685 (local address 127.10.192.67:44077)
0619 06:38:41.182366 (+ 980us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:41.182403 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:41.183944 (+ 1541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:41.184527 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:41.184534 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:41.184627 (+ 93us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:41.185277 (+ 650us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:38:41.185279 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:41.185317 (+ 38us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:38:41.185405 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:41.185738 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:41.185746 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:41.185751 (+ 5us) client_negotiation.cc:769] Sending connection context
0619 06:38:41.185972 (+ 221us) client_negotiation.cc:240] Negotiation successful
0619 06:38:41.186165 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":287,"threads_started":1}
I20260619 06:38:41.188117 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 15987
I20260619 06:38:41.188289 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:38:41.188601 16114 heartbeater.cc:347] Connected to a master server at 127.10.192.126:38685
I20260619 06:38:41.188766 11009 external_mini_cluster.cc:1428] Setting key 072a1a2df53888bebf71068f1133533d
I20260619 06:38:41.188930 16114 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:41.189610 16114 heartbeater.cc:511] Master 127.10.192.126:38685 requested a full tablet report, sending...
I20260619 06:38:41.191097 15666 ts_manager.cc:194] Registered new tserver with Master: f3357519f6df48a3a8fcab2e782f31e7 (127.10.192.67:36789)
I20260619 06:38:41.204107 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 06:38:41.211040 15855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.208388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54370 (local address 127.10.192.126:38685)
0619 06:38:41.208605 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:41.208614 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:41.209050 (+ 436us) server_negotiation.cc:407] Connection header received
0619 06:38:41.209255 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:41.209267 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:41.209319 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:41.209423 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:41.210382 (+ 959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:41.210388 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:41.210392 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:38:41.210410 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:41.210450 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:38:41.210462 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:41.210588 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:41.210691 (+ 103us) server_negotiation.cc:299] Negotiation successful
0619 06:38:41.210753 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260619 06:38:41.215165 15666 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54370:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:38:41.221968 15666 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:38:41.255188 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.234426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:33845 (local address 127.0.0.1:60642)
0619 06:38:41.235239 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:41.235285 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:41.235420 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:41.251169 (+ 15749us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:41.251178 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:41.251294 (+ 116us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:41.252214 (+ 920us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:38:41.252219 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:41.252258 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:38:41.252728 (+ 470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:41.254032 (+ 1304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:41.254045 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:41.254056 (+ 11us) client_negotiation.cc:769] Sending connection context
0619 06:38:41.254232 (+ 176us) client_negotiation.cc:240] Negotiation successful
0619 06:38:41.254343 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"threads_started":1}
I20260619 06:38:41.256187 16130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.234608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:44015 (local address 127.0.0.1:51104)
0619 06:38:41.246722 (+ 12114us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:41.246746 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:41.246856 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:41.254194 (+ 7338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:41.254201 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:41.254233 (+ 32us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:41.255021 (+ 788us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:38:41.255024 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:41.255042 (+ 18us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:38:41.255093 (+ 51us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:41.255569 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:41.255573 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:41.255577 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 06:38:41.255735 (+ 158us) client_negotiation.cc:240] Negotiation successful
0619 06:38:41.255786 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11948,"thread_start_us":478,"threads_started":1}
I20260619 06:38:41.256196 16128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.234800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51104 (local address 127.10.192.65:44015)
0619 06:38:41.253604 (+ 18804us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:41.253613 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:41.253645 (+ 32us) server_negotiation.cc:407] Connection header received
0619 06:38:41.253711 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:41.253720 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:41.254016 (+ 296us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:41.254225 (+ 209us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:41.255382 (+ 1157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:41.255389 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:41.255403 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:38:41.255417 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:41.255466 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:38:41.255483 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:41.255671 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:41.255735 (+ 64us) server_negotiation.cc:299] Negotiation successful
0619 06:38:41.255835 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18619,"thread_start_us":19380,"threads_started":1}
I20260619 06:38:41.257485 16129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.234961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60642 (local address 127.10.192.66:33845)
0619 06:38:41.250624 (+ 15663us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:41.250631 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:41.250660 (+ 29us) server_negotiation.cc:407] Connection header received
0619 06:38:41.250726 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:41.250732 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:41.250934 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:41.251144 (+ 210us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:41.253757 (+ 2613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:41.253767 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:41.253782 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:38:41.253801 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:41.253882 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:38:41.253902 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:41.256995 (+ 3093us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:41.257070 (+ 75us) server_negotiation.cc:299] Negotiation successful
0619 06:38:41.257162 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15518,"thread_start_us":16690,"threads_started":1}
I20260619 06:38:41.259697 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.237501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:36789 (local address 127.0.0.1:48692)
0619 06:38:41.255884 (+ 18383us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:41.255903 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:41.255992 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:41.256711 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:41.256715 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:41.256741 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:41.257344 (+ 603us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:38:41.257348 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:41.257372 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:38:41.257417 (+ 45us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:41.258853 (+ 1436us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:41.258858 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:41.258863 (+ 5us) client_negotiation.cc:769] Sending connection context
0619 06:38:41.258981 (+ 118us) client_negotiation.cc:240] Negotiation successful
0619 06:38:41.259367 (+ 386us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18267,"thread_start_us":8641,"threads_started":1}
I20260619 06:38:41.260244 16131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.238195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48692 (local address 127.10.192.67:36789)
0619 06:38:41.253104 (+ 14909us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:41.253121 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:41.256124 (+ 3003us) server_negotiation.cc:407] Connection header received
0619 06:38:41.256211 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:41.256221 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:41.256499 (+ 278us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:41.256662 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:41.258306 (+ 1644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:41.258313 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:41.258325 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:38:41.258341 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:41.258390 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:38:41.258409 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:41.258606 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:41.259795 (+ 1189us) server_negotiation.cc:299] Negotiation successful
0619 06:38:41.259894 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14735,"thread_start_us":13722,"threads_started":1}
I20260619 06:38:41.260486 15788 tablet_service.cc:1467] Processing CreateTablet for tablet 0d804345616b437e8110bf15e2912c30 (DEFAULT_TABLE table=test-table [id=41675c75955b40aeb55c51657e7405de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:41.261216 15919 tablet_service.cc:1467] Processing CreateTablet for tablet 0d804345616b437e8110bf15e2912c30 (DEFAULT_TABLE table=test-table [id=41675c75955b40aeb55c51657e7405de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:41.262029 15788 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d804345616b437e8110bf15e2912c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:41.262446 15919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d804345616b437e8110bf15e2912c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:41.264329 15853 heartbeater.cc:503] Master 127.10.192.126:38685 was elected leader, sending a full tablet report...
I20260619 06:38:41.263907 16049 tablet_service.cc:1467] Processing CreateTablet for tablet 0d804345616b437e8110bf15e2912c30 (DEFAULT_TABLE table=test-table [id=41675c75955b40aeb55c51657e7405de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:41.265343 16049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0d804345616b437e8110bf15e2912c30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:41.274039 16132 tablet_bootstrap.cc:492] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110: Bootstrap starting.
I20260619 06:38:41.276650 16133 tablet_bootstrap.cc:492] T 0d804345616b437e8110bf15e2912c30 P 84e47074cae541aa9cd82039ee7ad1dc: Bootstrap starting.
I20260619 06:38:41.279281 16132 tablet_bootstrap.cc:654] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:41.280210 16133 tablet_bootstrap.cc:654] T 0d804345616b437e8110bf15e2912c30 P 84e47074cae541aa9cd82039ee7ad1dc: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:41.280225 16134 tablet_bootstrap.cc:492] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7: Bootstrap starting.
I20260619 06:38:41.281035 16132 log.cc:824] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:41.281533 16133 log.cc:824] T 0d804345616b437e8110bf15e2912c30 P 84e47074cae541aa9cd82039ee7ad1dc: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:41.283722 16134 tablet_bootstrap.cc:654] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:41.284197 16132 tablet_bootstrap.cc:492] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110: No bootstrap required, opened a new log
I20260619 06:38:41.284472 16132 ts_tablet_manager.cc:1397] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.001s
I20260619 06:38:41.284648 16133 tablet_bootstrap.cc:492] T 0d804345616b437e8110bf15e2912c30 P 84e47074cae541aa9cd82039ee7ad1dc: No bootstrap required, opened a new log
I20260619 06:38:41.284919 16133 ts_tablet_manager.cc:1397] T 0d804345616b437e8110bf15e2912c30 P 84e47074cae541aa9cd82039ee7ad1dc: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.001s
I20260619 06:38:41.284943 16134 log.cc:824] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:41.289389 16134 tablet_bootstrap.cc:492] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7: No bootstrap required, opened a new log
I20260619 06:38:41.289680 16134 ts_tablet_manager.cc:1397] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s
I20260619 06:38:41.292649 16132 raft_consensus.cc:348] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5757686b01094e05aa4b19f282940110" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33845 } } peers { permanent_uuid: "84e47074cae541aa9cd82039ee7ad1dc" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 44015 } } peers { permanent_uuid: "f3357519f6df48a3a8fcab2e782f31e7" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36789 } }
I20260619 06:38:41.293058 16132 raft_consensus.cc:374] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:41.293161 16132 raft_consensus.cc:729] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5757686b01094e05aa4b19f282940110, State: Initialized, Role: FOLLOWER
I20260619 06:38:41.293833 16132 consensus_queue.cc:260] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5757686b01094e05aa4b19f282940110" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33845 } } peers { permanent_uuid: "84e47074cae541aa9cd82039ee7ad1dc" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 44015 } } peers { permanent_uuid: "f3357519f6df48a3a8fcab2e782f31e7" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36789 } }
I20260619 06:38:41.294999 15984 heartbeater.cc:503] Master 127.10.192.126:38685 was elected leader, sending a full tablet report...
I20260619 06:38:41.295534 16132 ts_tablet_manager.cc:1428] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110: Time spent starting tablet: real 0.011s user 0.003s sys 0.008s
I20260619 06:38:41.295360 16133 raft_consensus.cc:348] T 0d804345616b437e8110bf15e2912c30 P 84e47074cae541aa9cd82039ee7ad1dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5757686b01094e05aa4b19f282940110" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33845 } } peers { permanent_uuid: "84e47074cae541aa9cd82039ee7ad1dc" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 44015 } } peers { permanent_uuid: "f3357519f6df48a3a8fcab2e782f31e7" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36789 } }
I20260619 06:38:41.295857 16133 raft_consensus.cc:374] T 0d804345616b437e8110bf15e2912c30 P 84e47074cae541aa9cd82039ee7ad1dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:41.295957 16133 raft_consensus.cc:729] T 0d804345616b437e8110bf15e2912c30 P 84e47074cae541aa9cd82039ee7ad1dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84e47074cae541aa9cd82039ee7ad1dc, State: Initialized, Role: FOLLOWER
I20260619 06:38:41.296564 16133 consensus_queue.cc:260] T 0d804345616b437e8110bf15e2912c30 P 84e47074cae541aa9cd82039ee7ad1dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5757686b01094e05aa4b19f282940110" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33845 } } peers { permanent_uuid: "84e47074cae541aa9cd82039ee7ad1dc" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 44015 } } peers { permanent_uuid: "f3357519f6df48a3a8fcab2e782f31e7" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36789 } }
I20260619 06:38:41.298348 16133 ts_tablet_manager.cc:1428] T 0d804345616b437e8110bf15e2912c30 P 84e47074cae541aa9cd82039ee7ad1dc: Time spent starting tablet: real 0.013s user 0.010s sys 0.003s
I20260619 06:38:41.301275 16134 raft_consensus.cc:348] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5757686b01094e05aa4b19f282940110" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33845 } } peers { permanent_uuid: "84e47074cae541aa9cd82039ee7ad1dc" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 44015 } } peers { permanent_uuid: "f3357519f6df48a3a8fcab2e782f31e7" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36789 } }
I20260619 06:38:41.301736 16134 raft_consensus.cc:374] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:41.301862 16134 raft_consensus.cc:729] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3357519f6df48a3a8fcab2e782f31e7, State: Initialized, Role: FOLLOWER
I20260619 06:38:41.302487 16134 consensus_queue.cc:260] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5757686b01094e05aa4b19f282940110" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33845 } } peers { permanent_uuid: "84e47074cae541aa9cd82039ee7ad1dc" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 44015 } } peers { permanent_uuid: "f3357519f6df48a3a8fcab2e782f31e7" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36789 } }
I20260619 06:38:41.303488 16114 heartbeater.cc:503] Master 127.10.192.126:38685 was elected leader, sending a full tablet report...
I20260619 06:38:41.304170 16134 ts_tablet_manager.cc:1428] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7: Time spent starting tablet: real 0.014s user 0.009s sys 0.006s
W20260619 06:38:41.429945 16115 tablet.cc:2369] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 06:38:41.439945 15985 tablet.cc:2369] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:38:41.490619 16138 raft_consensus.cc:482] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:38:41.490952 16138 raft_consensus.cc:504] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5757686b01094e05aa4b19f282940110" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33845 } } peers { permanent_uuid: "84e47074cae541aa9cd82039ee7ad1dc" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 44015 } } peers { permanent_uuid: "f3357519f6df48a3a8fcab2e782f31e7" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36789 } }
I20260619 06:38:41.492808 16138 leader_election.cc:288] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 84e47074cae541aa9cd82039ee7ad1dc (127.10.192.65:44015), f3357519f6df48a3a8fcab2e782f31e7 (127.10.192.67:36789)
I20260619 06:38:41.496423 16128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.493233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:53409 (local address 127.10.192.65:44015)
0619 06:38:41.493458 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:41.493466 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:41.494479 (+ 1013us) server_negotiation.cc:407] Connection header received
0619 06:38:41.494661 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:41.494666 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:41.494725 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:41.494825 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:41.495809 (+ 984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:41.495814 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:41.495819 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:38:41.495837 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:41.495881 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:38:41.495893 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:41.496017 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:41.496091 (+ 74us) server_negotiation.cc:299] Negotiation successful
0619 06:38:41.496156 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260619 06:38:41.496591 16131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.493249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:48741 (local address 127.10.192.67:36789)
0619 06:38:41.493430 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:41.493446 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:41.494527 (+ 1081us) server_negotiation.cc:407] Connection header received
0619 06:38:41.494693 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:41.494696 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:41.494742 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:41.494837 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:41.495985 (+ 1148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:41.495989 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:41.495993 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:38:41.496008 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:41.496038 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:38:41.496050 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:41.496179 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:41.496252 (+ 73us) server_negotiation.cc:299] Negotiation successful
0619 06:38:41.496327 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260619 06:38:41.496785 16142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.493668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:36789 (local address 127.10.192.66:48741)
0619 06:38:41.494416 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:41.494430 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:41.494560 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:41.494854 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:41.494858 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:41.494881 (+ 23us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:41.495781 (+ 900us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:38:41.495783 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:41.495795 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:38:41.495828 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:41.496144 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:41.496148 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:41.496153 (+ 5us) client_negotiation.cc:769] Sending connection context
0619 06:38:41.496295 (+ 142us) client_negotiation.cc:240] Negotiation successful
0619 06:38:41.496345 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":662,"thread_start_us":446,"threads_started":1}
I20260619 06:38:41.496948 16141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.493576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:44015 (local address 127.10.192.66:53409)
0619 06:38:41.494348 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:41.494379 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:41.494524 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:41.494844 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:41.494848 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:41.494872 (+ 24us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:41.495560 (+ 688us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:38:41.495563 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:41.495575 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:38:41.495610 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:41.495982 (+ 372us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:41.495986 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:41.495990 (+ 4us) client_negotiation.cc:769] Sending connection context
0619 06:38:41.496138 (+ 148us) client_negotiation.cc:240] Negotiation successful
0619 06:38:41.496185 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":639,"thread_start_us":385,"threads_started":1}
I20260619 06:38:41.497812 16069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d804345616b437e8110bf15e2912c30" candidate_uuid: "5757686b01094e05aa4b19f282940110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3357519f6df48a3a8fcab2e782f31e7" is_pre_election: true
I20260619 06:38:41.498266 15808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d804345616b437e8110bf15e2912c30" candidate_uuid: "5757686b01094e05aa4b19f282940110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e47074cae541aa9cd82039ee7ad1dc" is_pre_election: true
I20260619 06:38:41.498411 16069 raft_consensus.cc:2454] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5757686b01094e05aa4b19f282940110 in term 0.
I20260619 06:38:41.498835 15808 raft_consensus.cc:2454] T 0d804345616b437e8110bf15e2912c30 P 84e47074cae541aa9cd82039ee7ad1dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5757686b01094e05aa4b19f282940110 in term 0.
W20260619 06:38:41.499027 15854 tablet.cc:2369] T 0d804345616b437e8110bf15e2912c30 P 84e47074cae541aa9cd82039ee7ad1dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:38:41.499147 15875 leader_election.cc:302] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5757686b01094e05aa4b19f282940110, f3357519f6df48a3a8fcab2e782f31e7; no voters:
I20260619 06:38:41.499557 16138 raft_consensus.cc:2781] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:38:41.499740 16138 raft_consensus.cc:482] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:38:41.499818 16138 raft_consensus.cc:3037] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:41.502120 16138 raft_consensus.cc:504] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5757686b01094e05aa4b19f282940110" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33845 } } peers { permanent_uuid: "84e47074cae541aa9cd82039ee7ad1dc" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 44015 } } peers { permanent_uuid: "f3357519f6df48a3a8fcab2e782f31e7" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36789 } }
I20260619 06:38:41.502671 16138 leader_election.cc:288] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [CANDIDATE]: Term 1 election: Requested vote from peers 84e47074cae541aa9cd82039ee7ad1dc (127.10.192.65:44015), f3357519f6df48a3a8fcab2e782f31e7 (127.10.192.67:36789)
I20260619 06:38:41.503119 15808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d804345616b437e8110bf15e2912c30" candidate_uuid: "5757686b01094e05aa4b19f282940110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84e47074cae541aa9cd82039ee7ad1dc"
I20260619 06:38:41.503211 16069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0d804345616b437e8110bf15e2912c30" candidate_uuid: "5757686b01094e05aa4b19f282940110" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3357519f6df48a3a8fcab2e782f31e7"
I20260619 06:38:41.503304 15808 raft_consensus.cc:3037] T 0d804345616b437e8110bf15e2912c30 P 84e47074cae541aa9cd82039ee7ad1dc [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:41.503470 16069 raft_consensus.cc:3037] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:41.505533 15808 raft_consensus.cc:2454] T 0d804345616b437e8110bf15e2912c30 P 84e47074cae541aa9cd82039ee7ad1dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5757686b01094e05aa4b19f282940110 in term 1.
I20260619 06:38:41.505993 15874 leader_election.cc:302] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5757686b01094e05aa4b19f282940110, 84e47074cae541aa9cd82039ee7ad1dc; no voters:
I20260619 06:38:41.506086 16069 raft_consensus.cc:2454] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5757686b01094e05aa4b19f282940110 in term 1.
I20260619 06:38:41.506302 16138 raft_consensus.cc:2781] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:41.506846 16138 raft_consensus.cc:686] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [term 1 LEADER]: Becoming Leader. State: Replica: 5757686b01094e05aa4b19f282940110, State: Running, Role: LEADER
I20260619 06:38:41.507391 16138 consensus_queue.cc:237] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5757686b01094e05aa4b19f282940110" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33845 } } peers { permanent_uuid: "84e47074cae541aa9cd82039ee7ad1dc" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 44015 } } peers { permanent_uuid: "f3357519f6df48a3a8fcab2e782f31e7" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36789 } }
I20260619 06:38:41.512334 15667 catalog_manager.cc:5495] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5757686b01094e05aa4b19f282940110 (127.10.192.66). New cstate: current_term: 1 leader_uuid: "5757686b01094e05aa4b19f282940110" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5757686b01094e05aa4b19f282940110" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33845 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "84e47074cae541aa9cd82039ee7ad1dc" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 44015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f3357519f6df48a3a8fcab2e782f31e7" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36789 } health_report { overall_health: UNKNOWN } } }
I20260619 06:38:41.540592 16129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.538445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60646 (local address 127.10.192.66:33845)
0619 06:38:41.538652 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:41.538658 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:41.538773 (+ 115us) server_negotiation.cc:407] Connection header received
0619 06:38:41.538953 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:41.538958 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:41.539040 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:41.539124 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:41.539984 (+ 860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:41.539989 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:41.539992 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:38:41.540007 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:41.540038 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:38:41.540049 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:41.540139 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:41.540234 (+ 95us) server_negotiation.cc:299] Negotiation successful
0619 06:38:41.540279 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 06:38:41.549124 15808 raft_consensus.cc:1261] T 0d804345616b437e8110bf15e2912c30 P 84e47074cae541aa9cd82039ee7ad1dc [term 1 FOLLOWER]: Refusing update from remote peer 5757686b01094e05aa4b19f282940110: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:41.549124 16069 raft_consensus.cc:1261] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7 [term 1 FOLLOWER]: Refusing update from remote peer 5757686b01094e05aa4b19f282940110: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:41.550194 16143 consensus_queue.cc:1035] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3357519f6df48a3a8fcab2e782f31e7" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:41.550534 16138 consensus_queue.cc:1035] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84e47074cae541aa9cd82039ee7ad1dc" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 44015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:41.562470 16146 mvcc.cc:205] Tried to move back new op lower bound from 7298462193854328832 to 7298462193698426880. Current Snapshot: MvccSnapshot[applied={T|T < 7298462193854328832}]
I20260619 06:38:41.564193 16147 mvcc.cc:205] Tried to move back new op lower bound from 7298462193854328832 to 7298462193698426880. Current Snapshot: MvccSnapshot[applied={T|T < 7298462193854328832}]
I20260619 06:38:41.576638 15666 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:38:41.576901 15666 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54370:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:38:41.580467 15666 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b476036539e443bfae8d854e8ab8cffd: Sending DeleteTablet for 3 replicas of tablet 0d804345616b437e8110bf15e2912c30
I20260619 06:38:41.581681 15788 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d804345616b437e8110bf15e2912c30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:41 UTC) from {username='slave'} at 127.0.0.1:51104
I20260619 06:38:41.581679 15919 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d804345616b437e8110bf15e2912c30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:41 UTC) from {username='slave'} at 127.0.0.1:60642
I20260619 06:38:41.582839 16049 tablet_service.cc:1514] Processing DeleteTablet for tablet 0d804345616b437e8110bf15e2912c30 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:41 UTC) from {username='slave'} at 127.0.0.1:48692
I20260619 06:38:41.583647 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 15726
I20260619 06:38:41.591450 16155 tablet_replica.cc:330] T 0d804345616b437e8110bf15e2912c30 P 84e47074cae541aa9cd82039ee7ad1dc: stopping tablet replica
I20260619 06:38:41.592099 16157 tablet_replica.cc:330] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7: stopping tablet replica
I20260619 06:38:41.592677 16157 raft_consensus.cc:2229] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:41.592875 16156 tablet_replica.cc:330] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110: stopping tablet replica
I20260619 06:38:41.593190 16155 raft_consensus.cc:2229] T 0d804345616b437e8110bf15e2912c30 P 84e47074cae541aa9cd82039ee7ad1dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:41.593739 16155 raft_consensus.cc:2258] T 0d804345616b437e8110bf15e2912c30 P 84e47074cae541aa9cd82039ee7ad1dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:41.593286 16156 raft_consensus.cc:2229] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:38:41.594349 16157 raft_consensus.cc:2258] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:41.594393 16156 raft_consensus.cc:2258] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:41.594738 16128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.585238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51114 (local address 127.10.192.65:44015)
0619 06:38:41.585458 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:41.585467 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:41.590295 (+ 4828us) server_negotiation.cc:407] Connection header received
0619 06:38:41.590527 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:41.590537 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:41.590677 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:41.590794 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:41.593786 (+ 2992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:41.593792 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:41.593800 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:38:41.593838 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:41.593879 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:38:41.593903 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:41.594049 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:41.594358 (+ 309us) server_negotiation.cc:299] Negotiation successful
0619 06:38:41.594440 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260619 06:38:41.595671 15848 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:41.597927 16157 ts_tablet_manager.cc:1905] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:41.602705 16157 ts_tablet_manager.cc:1918] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:38:41.602872 16157 log.cc:1196] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/0d804345616b437e8110bf15e2912c30
I20260619 06:38:41.603440 16157 ts_tablet_manager.cc:1939] T 0d804345616b437e8110bf15e2912c30 P f3357519f6df48a3a8fcab2e782f31e7: Deleting consensus metadata
I20260619 06:38:41.603494 16156 ts_tablet_manager.cc:1905] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:41.605378 15654 catalog_manager.cc:4841] TS f3357519f6df48a3a8fcab2e782f31e7 (127.10.192.67:36789): tablet 0d804345616b437e8110bf15e2912c30 (table test-table [id=41675c75955b40aeb55c51657e7405de]) successfully deleted
I20260619 06:38:41.610458 16156 ts_tablet_manager.cc:1918] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:38:41.610652 16156 log.cc:1196] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/0d804345616b437e8110bf15e2912c30
I20260619 06:38:41.611183 16156 ts_tablet_manager.cc:1939] T 0d804345616b437e8110bf15e2912c30 P 5757686b01094e05aa4b19f282940110: Deleting consensus metadata
I20260619 06:38:41.613121 15651 catalog_manager.cc:4841] TS 5757686b01094e05aa4b19f282940110 (127.10.192.66:33845): tablet 0d804345616b437e8110bf15e2912c30 (table test-table [id=41675c75955b40aeb55c51657e7405de]) successfully deleted
I20260619 06:38:41.699793 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 15726
W20260619 06:38:41.727566 15653 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.192.65:44015 (error 108)
I20260619 06:38:41.727790 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 15857
I20260619 06:38:41.731484 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.730976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:44015 (local address 127.0.0.1:51120)
0619 06:38:41.731157 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:41.731287 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:44015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260619 06:38:41.731830 15653 catalog_manager.cc:4584] TS 84e47074cae541aa9cd82039ee7ad1dc (127.10.192.65:44015): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0d804345616b437e8110bf15e2912c30: Network error: Client connection negotiation failed: client connection to 127.10.192.65:44015: connect: Connection refused (error 111)
I20260619 06:38:41.732026 16129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.729506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60656 (local address 127.10.192.66:33845)
0619 06:38:41.729684 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:41.729690 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:41.729709 (+ 19us) server_negotiation.cc:407] Connection header received
0619 06:38:41.729790 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:41.729795 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:41.729858 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:41.729975 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:41.731238 (+ 1263us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:41.731244 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:41.731248 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:38:41.731266 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:41.731314 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:38:41.731331 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:41.731474 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:41.731660 (+ 186us) server_negotiation.cc:299] Negotiation successful
0619 06:38:41.731722 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260619 06:38:41.732772 15979 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:41.785406 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.784924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:44015 (local address 127.0.0.1:51134)
0619 06:38:41.785149 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:41.785257 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:44015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260619 06:38:41.786548 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.786171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:44015 (local address 127.0.0.1:51144)
0619 06:38:41.786348 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:41.786423 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:44015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260619 06:38:41.844162 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 15857
I20260619 06:38:41.846850 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.846376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:44015 (local address 127.0.0.1:51150)
0619 06:38:41.846570 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:41.846672 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:44015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260619 06:38:41.848183 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.847784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:44015 (local address 127.0.0.1:51158)
0619 06:38:41.847967 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:41.848043 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:44015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260619 06:38:41.862684 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 15987
I20260619 06:38:41.865482 16131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.863480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48696 (local address 127.10.192.67:36789)
0619 06:38:41.863710 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:41.863720 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:41.863739 (+ 19us) server_negotiation.cc:407] Connection header received
0619 06:38:41.863813 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:41.863816 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:41.863911 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:41.863997 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:41.864859 (+ 862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:41.864863 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:41.864875 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:38:41.864890 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:41.864919 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:38:41.864931 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:41.865031 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:41.865108 (+ 77us) server_negotiation.cc:299] Negotiation successful
0619 06:38:41.865153 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260619 06:38:41.866189 16109 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:41.928849 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.928370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:44015 (local address 127.0.0.1:51160)
0619 06:38:41.928608 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:41.928708 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:44015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260619 06:38:41.929972 16127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:41.929564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:44015 (local address 127.0.0.1:51170)
0619 06:38:41.929770 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:41.929837 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:44015: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260619 06:38:41.953500 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 15987
I20260619 06:38:41.969661 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 15636
I20260619 06:38:41.970827 15697 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:42.076349 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 15636
2026-06-19T06:38:42Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (2835 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260619 06:38:42.117559 11009 mini_oidc.cc:152] Starting JWKS server
I20260619 06:38:42.120153 11009 webserver.cc:460] Webserver started at https://127.0.0.1:39127/ using document root <none> and password file <none>
I20260619 06:38:42.120498 11009 mini_oidc.cc:189] Starting OIDC Discovery server
I20260619 06:38:42.121155 11009 webserver.cc:460] Webserver started at http://127.0.0.1:45881/ using document root <none> and password file <none>
2026-06-19T06:38:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:38:42Z Disabled control of system clock
I20260619 06:38:42.147709 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:34413
--webserver_interface=127.10.192.126
--webserver_port=0
--builtin_ntp_servers=127.10.192.84:38777
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:34413
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39127/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0/testchainca.cert with env {}
W20260619 06:38:42.472558 16169 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:42.472868 16169 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:42.472966 16169 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:42.480429 16169 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:38:42.480562 16169 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:42.480602 16169 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:42.480667 16169 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:38:42.480711 16169 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260619 06:38:42.480782 16169 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260619 06:38:42.480829 16169 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39127/jwks.json
I20260619 06:38:42.491132 16169 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:38777
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:34413
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:34413
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39127/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:42.492470 16169 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:42.493760 16169 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:42.505899 16174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:42.505950 16177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:42.505981 16175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:42.507411 16169 server_base.cc:1034] running on GCE node
I20260619 06:38:42.508296 16169 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:42.509783 16169 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:42.510984 16169 hybrid_clock.cc:648] HybridClock initialized: now 1781851122510924 us; error 55 us; skew 500 ppm
I20260619 06:38:42.511359 16169 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:38:42.513945 16169 webserver.cc:460] Webserver started at http://127.10.192.126:46823/ using document root <none> and password file <none>
I20260619 06:38:42.514660 16169 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:42.514783 16169 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:42.515113 16169 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:42.518241 16169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "5ff6aeac6aba47abae4cfa520e80f953"
format_stamp: "Formatted at 2026-06-19 06:38:42 on dist-test-slave-7lz4"
server_key: "ba6bd386d6196ffe68ef361b6319dded"
server_key_iv: "88d68742fc74648b4eaa1fabffdbde0a"
server_key_version: "encryptionkey@0"
I20260619 06:38:42.519086 16169 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "5ff6aeac6aba47abae4cfa520e80f953"
format_stamp: "Formatted at 2026-06-19 06:38:42 on dist-test-slave-7lz4"
server_key: "ba6bd386d6196ffe68ef361b6319dded"
server_key_iv: "88d68742fc74648b4eaa1fabffdbde0a"
server_key_version: "encryptionkey@0"
I20260619 06:38:42.524487 16169 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260619 06:38:42.528254 16183 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:42.529712 16169 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:38:42.529920 16169 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "5ff6aeac6aba47abae4cfa520e80f953"
format_stamp: "Formatted at 2026-06-19 06:38:42 on dist-test-slave-7lz4"
server_key: "ba6bd386d6196ffe68ef361b6319dded"
server_key_iv: "88d68742fc74648b4eaa1fabffdbde0a"
server_key_version: "encryptionkey@0"
I20260619 06:38:42.530164 16169 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:42.553351 16169 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:42.554280 16169 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:42.554613 16169 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:42.573577 16169 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:34413
I20260619 06:38:42.573590 16234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:34413 every 8 connection(s)
I20260619 06:38:42.575018 16169 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:38:42.577083 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 16169
I20260619 06:38:42.577324 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:38:42.577956 11009 external_mini_cluster.cc:1428] Setting key 9041f9acfc3345d442c51c314933f7c7
I20260619 06:38:42.579299 16235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:42.591789 16235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953: Bootstrap starting.
I20260619 06:38:42.591894 16238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:42.579930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48790 (local address 127.10.192.126:34413)
0619 06:38:42.580906 (+ 976us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:42.580917 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:42.580967 (+ 50us) server_negotiation.cc:407] Connection header received
0619 06:38:42.582544 (+ 1577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:42.582568 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:42.583093 (+ 525us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:42.583528 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:42.584159 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:42.585698 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:42.587102 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:42.587864 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:42.588078 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:42.589373 (+ 1295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:42.589381 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:42.589400 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:38:42.590023 (+ 623us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:42.590104 (+ 81us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:38:42.590126 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:42.590260 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:42.590485 (+ 225us) server_negotiation.cc:299] Negotiation successful
0619 06:38:42.590817 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":557,"thread_start_us":352,"threads_started":1}
I20260619 06:38:42.595562 16235 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:42.595893 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:38:42.596717 16235 log.cc:824] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:42.599676 16235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953: No bootstrap required, opened a new log
I20260619 06:38:42.606882 16235 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ff6aeac6aba47abae4cfa520e80f953" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34413 } }
I20260619 06:38:42.607286 16235 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:42.607395 16235 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ff6aeac6aba47abae4cfa520e80f953, State: Initialized, Role: FOLLOWER
I20260619 06:38:42.608110 16235 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ff6aeac6aba47abae4cfa520e80f953" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34413 } }
I20260619 06:38:42.608431 16235 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:38:42.608582 16235 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:38:42.608755 16235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:42.610891 16235 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ff6aeac6aba47abae4cfa520e80f953" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34413 } }
I20260619 06:38:42.611431 16235 leader_election.cc:302] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ff6aeac6aba47abae4cfa520e80f953; no voters:
I20260619 06:38:42.612041 16235 leader_election.cc:288] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:38:42.612195 16240 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:42.612911 16240 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953 [term 1 LEADER]: Becoming Leader. State: Replica: 5ff6aeac6aba47abae4cfa520e80f953, State: Running, Role: LEADER
I20260619 06:38:42.613513 16240 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ff6aeac6aba47abae4cfa520e80f953" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34413 } }
I20260619 06:38:42.614207 16235 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:38:42.618252 16242 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ff6aeac6aba47abae4cfa520e80f953. Latest consensus state: current_term: 1 leader_uuid: "5ff6aeac6aba47abae4cfa520e80f953" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ff6aeac6aba47abae4cfa520e80f953" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34413 } } }
I20260619 06:38:42.618315 16241 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ff6aeac6aba47abae4cfa520e80f953" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ff6aeac6aba47abae4cfa520e80f953" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34413 } } }
I20260619 06:38:42.618798 16242 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:42.618808 16241 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:42.620483 16250 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:38:42.626127 16250 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:38:42.635345 16250 catalog_manager.cc:1347] Generated new cluster ID: 2a9652af032041ac8eea1da356367908
I20260619 06:38:42.635546 16250 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:38:42.664330 16250 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:38:42.665730 16250 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:38:42.677106 16250 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5ff6aeac6aba47abae4cfa520e80f953: Generated new TSK 0
I20260619 06:38:42.678054 16250 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260619 06:38:42.736045 16265 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260619 06:38:42.736415 16265 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260619 06:38:42.737334 16238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:42.697175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48792 (local address 127.10.192.126:34413)
0619 06:38:42.697384 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:42.697391 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:42.697887 (+ 496us) server_negotiation.cc:407] Connection header received
0619 06:38:42.698236 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:42.698242 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:42.698338 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:42.698514 (+ 176us) server_negotiation.cc:226] Negotiated authn=JWT
0619 06:38:42.699055 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:42.700250 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:42.702674 (+ 2424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:42.703674 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:42.703831 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:42.704743 (+ 912us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0619 06:38:42.736628 (+ 31885us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39127/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0619 06:38:42.737005 (+ 377us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48792: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39127/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":67}
W20260619 06:38:42.737474 16238 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48792: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39127/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260619 06:38:42.740012 16264 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:38:42.697081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:34413 (local address 127.0.0.1:48792)
0619 06:38:42.697781 (+ 700us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:42.697798 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:42.697972 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:42.698563 (+ 591us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:42.698566 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:42.698576 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0619 06:38:42.698907 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:42.698915 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:42.700433 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:42.700438 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:42.702439 (+ 2001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:42.702457 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:42.703920 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:42.703929 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:42.704216 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:42.704322 (+ 106us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0619 06:38:42.737731 (+ 33409us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39127/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0619 06:38:42.738115 (+ 384us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.192.126:34413: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39127/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":390,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.10.192.126:34413: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39127/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260619 06:38:42.741279 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 16169
I20260619 06:38:42.742553 16230 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:42.854422 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 16169
2026-06-19T06:38:42Z chronyd exiting
I20260619 06:38:42.904745 11009 test_util.cc:175] -----------------------------------------------
I20260619 06:38:42.904883 11009 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1781851080573990-11009-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (791 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260619 06:38:42.908558 11009 mini_oidc.cc:152] Starting JWKS server
I20260619 06:38:42.910349 11009 webserver.cc:460] Webserver started at https://127.0.0.1:43559/ using document root <none> and password file <none>
I20260619 06:38:42.910545 11009 mini_oidc.cc:189] Starting OIDC Discovery server
I20260619 06:38:42.911103 11009 webserver.cc:460] Webserver started at http://127.0.0.1:39495/ using document root <none> and password file <none>
2026-06-19T06:38:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:38:42Z Disabled control of system clock
I20260619 06:38:42.936825 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:40963
--webserver_interface=127.10.192.126
--webserver_port=0
--builtin_ntp_servers=127.10.192.84:33995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:40963
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43559/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781851080573990-11009-0/testchainca.cert with env {}
W20260619 06:38:43.261714 16272 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:43.262034 16272 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:43.262212 16272 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:43.269516 16272 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:38:43.269634 16272 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:43.269740 16272 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:43.269860 16272 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:38:43.269954 16272 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260619 06:38:43.270067 16272 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260619 06:38:43.270129 16272 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43559/jwks.json
I20260619 06:38:43.280368 16272 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:33995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:40963
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:40963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43559/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781851080573990-11009-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:43.281767 16272 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:43.283162 16272 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:43.295059 16278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:43.295032 16280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:43.295104 16277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:43.295830 16272 server_base.cc:1034] running on GCE node
I20260619 06:38:43.296663 16272 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:43.298215 16272 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:43.299469 16272 hybrid_clock.cc:648] HybridClock initialized: now 1781851123299422 us; error 45 us; skew 500 ppm
I20260619 06:38:43.299880 16272 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:38:43.305523 16272 webserver.cc:460] Webserver started at http://127.10.192.126:46689/ using document root <none> and password file <none>
I20260619 06:38:43.306252 16272 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:43.306396 16272 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:43.306732 16272 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:43.309780 16272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "8186c3e194734304b7190fb2f3c722a1"
format_stamp: "Formatted at 2026-06-19 06:38:43 on dist-test-slave-7lz4"
server_key: "5972465347d7fbc7be236d7caad229e2"
server_key_iv: "ea1fd174469395949d2b7dbd49d2ca91"
server_key_version: "encryptionkey@0"
I20260619 06:38:43.310608 16272 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "8186c3e194734304b7190fb2f3c722a1"
format_stamp: "Formatted at 2026-06-19 06:38:43 on dist-test-slave-7lz4"
server_key: "5972465347d7fbc7be236d7caad229e2"
server_key_iv: "ea1fd174469395949d2b7dbd49d2ca91"
server_key_version: "encryptionkey@0"
I20260619 06:38:43.315953 16272 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 06:38:43.319342 16286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:43.320824 16272 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:38:43.321012 16272 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "8186c3e194734304b7190fb2f3c722a1"
format_stamp: "Formatted at 2026-06-19 06:38:43 on dist-test-slave-7lz4"
server_key: "5972465347d7fbc7be236d7caad229e2"
server_key_iv: "ea1fd174469395949d2b7dbd49d2ca91"
server_key_version: "encryptionkey@0"
I20260619 06:38:43.321234 16272 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:43.350723 16272 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:43.351683 16272 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:43.352008 16272 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:43.370205 16272 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:40963
I20260619 06:38:43.370230 16337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:40963 every 8 connection(s)
I20260619 06:38:43.371748 16272 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:38:43.375799 16338 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:43.375861 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 16272
I20260619 06:38:43.376047 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:38:43.376844 11009 external_mini_cluster.cc:1428] Setting key 73586c796dfdd1ed9409475680f803c8
I20260619 06:38:43.389979 16338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1: Bootstrap starting.
I20260619 06:38:43.391619 16341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:43.378984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45926 (local address 127.10.192.126:40963)
0619 06:38:43.380116 (+ 1132us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:43.380127 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:43.380173 (+ 46us) server_negotiation.cc:407] Connection header received
0619 06:38:43.382238 (+ 2065us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:43.382265 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:43.382808 (+ 543us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:43.383190 (+ 382us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:43.383757 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:43.385036 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:43.386936 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:43.387744 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:43.387906 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:43.389108 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:43.389115 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:43.389132 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:38:43.389696 (+ 564us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:43.389778 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:38:43.389799 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:43.389909 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:43.390214 (+ 305us) server_negotiation.cc:299] Negotiation successful
0619 06:38:43.390606 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":668,"thread_start_us":426,"threads_started":1}
I20260619 06:38:43.393831 16338 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:43.395076 16338 log.cc:824] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:43.396312 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:38:43.398155 16338 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1: No bootstrap required, opened a new log
I20260619 06:38:43.406044 16338 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8186c3e194734304b7190fb2f3c722a1" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40963 } }
I20260619 06:38:43.406461 16338 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:43.406561 16338 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8186c3e194734304b7190fb2f3c722a1, State: Initialized, Role: FOLLOWER
I20260619 06:38:43.407137 16338 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8186c3e194734304b7190fb2f3c722a1" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40963 } }
I20260619 06:38:43.407392 16338 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:38:43.407543 16338 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:38:43.407730 16338 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:43.409966 16338 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8186c3e194734304b7190fb2f3c722a1" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40963 } }
I20260619 06:38:43.410506 16338 leader_election.cc:302] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8186c3e194734304b7190fb2f3c722a1; no voters:
I20260619 06:38:43.411098 16338 leader_election.cc:288] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:38:43.411248 16343 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:43.412066 16343 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1 [term 1 LEADER]: Becoming Leader. State: Replica: 8186c3e194734304b7190fb2f3c722a1, State: Running, Role: LEADER
I20260619 06:38:43.412715 16343 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8186c3e194734304b7190fb2f3c722a1" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40963 } }
I20260619 06:38:43.413465 16338 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:38:43.416173 16345 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8186c3e194734304b7190fb2f3c722a1. Latest consensus state: current_term: 1 leader_uuid: "8186c3e194734304b7190fb2f3c722a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8186c3e194734304b7190fb2f3c722a1" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40963 } } }
I20260619 06:38:43.416635 16345 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:43.416802 16344 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8186c3e194734304b7190fb2f3c722a1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8186c3e194734304b7190fb2f3c722a1" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40963 } } }
I20260619 06:38:43.417248 16344 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:43.418754 16352 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:38:43.424211 16352 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:38:43.434253 16352 catalog_manager.cc:1347] Generated new cluster ID: a74e4526159747dcaf5a7fb6a1f76437
I20260619 06:38:43.434393 16352 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:38:43.448218 16352 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:38:43.450109 16352 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:38:43.461160 16352 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8186c3e194734304b7190fb2f3c722a1: Generated new TSK 0
I20260619 06:38:43.462255 16352 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260619 06:38:43.508744 16368 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260619 06:38:43.508898 16368 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260619 06:38:43.510234 16341 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:43.489685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45938 (local address 127.10.192.126:40963)
0619 06:38:43.489879 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:43.489886 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:43.490300 (+ 414us) server_negotiation.cc:407] Connection header received
0619 06:38:43.490520 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:43.490526 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:43.490615 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:43.490797 (+ 182us) server_negotiation.cc:226] Negotiated authn=JWT
0619 06:38:43.491251 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:43.492422 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:43.493781 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:43.494520 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:43.494644 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:43.495190 (+ 546us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0619 06:38:43.509501 (+ 14311us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43559/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0619 06:38:43.509908 (+ 407us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:45938: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43559/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":73}
W20260619 06:38:43.510385 16341 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:45938: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43559/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260619 06:38:43.510386 16367 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:38:43.489488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:40963 (local address 127.0.0.1:45938)
0619 06:38:43.490189 (+ 701us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:43.490205 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:43.490334 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:43.490814 (+ 480us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:43.490816 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:43.490826 (+ 10us) client_negotiation.cc:189] Negotiated authn=JWT
0619 06:38:43.491087 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:43.491094 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:43.492567 (+ 1473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:43.492571 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:43.493637 (+ 1066us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:43.493648 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:43.494701 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:43.494706 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:43.494854 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:43.494897 (+ 43us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0619 06:38:43.509791 (+ 14894us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43559/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0619 06:38:43.510029 (+ 238us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.192.126:40963: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43559/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":558,"thread_start_us":383,"threads_started":1}
I20260619 06:38:43.512290 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 16272
I20260619 06:38:43.513511 16333 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:43.607764 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 16272
2026-06-19T06:38:43Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (754 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260619 06:38:43.663144 11009 mini_oidc.cc:152] Starting JWKS server
I20260619 06:38:43.665066 11009 webserver.cc:460] Webserver started at https://127.0.0.1:44895/ using document root <none> and password file <none>
I20260619 06:38:43.665330 11009 mini_oidc.cc:189] Starting OIDC Discovery server
I20260619 06:38:43.665947 11009 webserver.cc:460] Webserver started at http://127.0.0.1:37075/ using document root <none> and password file <none>
2026-06-19T06:38:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:38:43Z Disabled control of system clock
I20260619 06:38:43.693897 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:33989
--webserver_interface=127.10.192.126
--webserver_port=0
--builtin_ntp_servers=127.10.192.84:39901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:33989
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44895/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260619 06:38:44.030367 16375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:44.030686 16375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:44.030776 16375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:44.038187 16375 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:38:44.038309 16375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:44.038349 16375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:44.038407 16375 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:38:44.038445 16375 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260619 06:38:44.038501 16375 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260619 06:38:44.038533 16375 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44895/jwks.json
I20260619 06:38:44.047787 16375 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:39901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:33989
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:33989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44895/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:44.049065 16375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:44.050844 16375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:44.063051 16381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:44.063520 16380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:44.063578 16383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:44.064394 16375 server_base.cc:1034] running on GCE node
I20260619 06:38:44.065261 16375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:44.066864 16375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:44.068076 16375 hybrid_clock.cc:648] HybridClock initialized: now 1781851124068038 us; error 44 us; skew 500 ppm
I20260619 06:38:44.068462 16375 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:38:44.070883 16375 webserver.cc:460] Webserver started at http://127.10.192.126:44423/ using document root <none> and password file <none>
I20260619 06:38:44.071705 16375 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:44.071828 16375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:44.072196 16375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:44.075181 16375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "f537e7fb4bb64f2abcdd2210d7ed3a49"
format_stamp: "Formatted at 2026-06-19 06:38:44 on dist-test-slave-7lz4"
server_key: "d8cd2e8a0ca5364b5bc2b1b58251c892"
server_key_iv: "9223dddb66f307ebbf9d809c563c3055"
server_key_version: "encryptionkey@0"
I20260619 06:38:44.076073 16375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "f537e7fb4bb64f2abcdd2210d7ed3a49"
format_stamp: "Formatted at 2026-06-19 06:38:44 on dist-test-slave-7lz4"
server_key: "d8cd2e8a0ca5364b5bc2b1b58251c892"
server_key_iv: "9223dddb66f307ebbf9d809c563c3055"
server_key_version: "encryptionkey@0"
I20260619 06:38:44.081307 16375 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260619 06:38:44.085081 16389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:44.086576 16375 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:38:44.086866 16375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "f537e7fb4bb64f2abcdd2210d7ed3a49"
format_stamp: "Formatted at 2026-06-19 06:38:44 on dist-test-slave-7lz4"
server_key: "d8cd2e8a0ca5364b5bc2b1b58251c892"
server_key_iv: "9223dddb66f307ebbf9d809c563c3055"
server_key_version: "encryptionkey@0"
I20260619 06:38:44.087105 16375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:44.103375 16375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:44.104298 16375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:44.104630 16375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:44.123304 16375 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:33989
I20260619 06:38:44.123328 16440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:33989 every 8 connection(s)
I20260619 06:38:44.124744 16375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:38:44.128680 16441 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:44.133616 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 16375
I20260619 06:38:44.133855 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:38:44.134461 11009 external_mini_cluster.cc:1428] Setting key f2e704a0268f1c6171e89b9fa87be2b8
I20260619 06:38:44.139973 16441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49: Bootstrap starting.
I20260619 06:38:44.143155 16441 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:44.144312 16441 log.cc:824] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:44.147332 16441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49: No bootstrap required, opened a new log
I20260619 06:38:44.148231 16444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:44.136465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37692 (local address 127.10.192.126:33989)
0619 06:38:44.137498 (+ 1033us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:44.137513 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:44.137558 (+ 45us) server_negotiation.cc:407] Connection header received
0619 06:38:44.139272 (+ 1714us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:44.139296 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:44.139855 (+ 559us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:44.140260 (+ 405us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:44.140828 (+ 568us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:44.142154 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:44.143559 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:44.144310 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:44.144516 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:44.145702 (+ 1186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:44.145710 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:44.145725 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:38:44.146266 (+ 541us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:44.146348 (+ 82us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:38:44.146372 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:44.146498 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:44.146733 (+ 235us) server_negotiation.cc:299] Negotiation successful
0619 06:38:44.147058 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":347,"threads_started":1}
I20260619 06:38:44.152074 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:38:44.156112 16441 raft_consensus.cc:348] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f537e7fb4bb64f2abcdd2210d7ed3a49" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33989 } }
I20260619 06:38:44.156504 16441 raft_consensus.cc:374] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:44.156623 16441 raft_consensus.cc:729] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f537e7fb4bb64f2abcdd2210d7ed3a49, State: Initialized, Role: FOLLOWER
I20260619 06:38:44.157311 16441 consensus_queue.cc:260] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f537e7fb4bb64f2abcdd2210d7ed3a49" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33989 } }
I20260619 06:38:44.157593 16441 raft_consensus.cc:388] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:38:44.157759 16441 raft_consensus.cc:482] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:38:44.157948 16441 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:44.160328 16441 raft_consensus.cc:504] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f537e7fb4bb64f2abcdd2210d7ed3a49" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33989 } }
I20260619 06:38:44.160970 16441 leader_election.cc:302] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f537e7fb4bb64f2abcdd2210d7ed3a49; no voters:
I20260619 06:38:44.161548 16441 leader_election.cc:288] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:38:44.161706 16446 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:44.162390 16446 raft_consensus.cc:686] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49 [term 1 LEADER]: Becoming Leader. State: Replica: f537e7fb4bb64f2abcdd2210d7ed3a49, State: Running, Role: LEADER
I20260619 06:38:44.162925 16446 consensus_queue.cc:237] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f537e7fb4bb64f2abcdd2210d7ed3a49" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33989 } }
I20260619 06:38:44.163759 16441 sys_catalog.cc:564] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:38:44.165980 16447 sys_catalog.cc:455] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f537e7fb4bb64f2abcdd2210d7ed3a49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f537e7fb4bb64f2abcdd2210d7ed3a49" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33989 } } }
I20260619 06:38:44.165951 16448 sys_catalog.cc:455] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f537e7fb4bb64f2abcdd2210d7ed3a49. Latest consensus state: current_term: 1 leader_uuid: "f537e7fb4bb64f2abcdd2210d7ed3a49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f537e7fb4bb64f2abcdd2210d7ed3a49" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33989 } } }
I20260619 06:38:44.166440 16447 sys_catalog.cc:458] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:44.166471 16448 sys_catalog.cc:458] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:44.168550 16451 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:38:44.173902 16451 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:38:44.183420 16451 catalog_manager.cc:1347] Generated new cluster ID: a672f5a6e3e54af6adba3b1f2282fbc8
I20260619 06:38:44.183538 16451 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:38:44.197492 16451 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:38:44.198786 16451 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:38:44.205245 16451 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f537e7fb4bb64f2abcdd2210d7ed3a49: Generated new TSK 0
I20260619 06:38:44.206144 16451 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:38:44.235910 16444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:44.227283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37694 (local address 127.10.192.126:33989)
0619 06:38:44.227528 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:44.227537 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:44.227909 (+ 372us) server_negotiation.cc:407] Connection header received
0619 06:38:44.228146 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:44.228149 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:44.228216 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:44.228346 (+ 130us) server_negotiation.cc:226] Negotiated authn=JWT
0619 06:38:44.228894 (+ 548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:44.229634 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:44.231625 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:44.232104 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:44.232206 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:44.232811 (+ 605us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0619 06:38:44.235212 (+ 2401us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44895/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0619 06:38:44.235553 (+ 341us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37694: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44895/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":102}
W20260619 06:38:44.236035 16444 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37694: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44895/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260619 06:38:44.238066 16470 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:38:44.227098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33989 (local address 127.0.0.1:37694)
0619 06:38:44.227795 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:44.227816 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:44.227973 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:44.228385 (+ 412us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:44.228390 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:44.228403 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0619 06:38:44.228738 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:44.228749 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:44.229789 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:44.229795 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:44.231480 (+ 1685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:44.231495 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:44.232304 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:44.232311 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:44.232510 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:44.232555 (+ 45us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0619 06:38:44.235434 (+ 2879us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44895/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0619 06:38:44.237561 (+ 2127us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.192.126:33989: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44895/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":545,"mutex_wait_us":1774,"thread_start_us":346,"threads_started":1}
I20260619 06:38:44.239877 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 16375
I20260619 06:38:44.241036 16436 generic_service.cc:196] Checking for leaks (request via RPC)
E20260619 06:38:44.250665 16471 webserver.cc:533] Webserver: sslize failed:
E20260619 06:38:44.250819 16471 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260619 06:38:44.335263 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 16375
2026-06-19T06:38:44Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (727 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-06-19T06:38:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:38:44Z Disabled control of system clock
I20260619 06:38:44.417452 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:40671
--webserver_interface=127.10.192.126
--webserver_port=0
--builtin_ntp_servers=127.10.192.84:34859
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:40671
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781851080573990-11009-0/testchainca.cert with env {}
W20260619 06:38:44.753312 16476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:44.753626 16476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:44.753713 16476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:44.760797 16476 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:38:44.760911 16476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:44.760949 16476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:44.761005 16476 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:38:44.761050 16476 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260619 06:38:44.761106 16476 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260619 06:38:44.761145 16476 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260619 06:38:44.771086 16476 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:34859
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:40671
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:40671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781851080573990-11009-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:44.772508 16476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:44.773800 16476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:44.785576 16481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:44.785780 16484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:44.785818 16482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:44.786324 16476 server_base.cc:1034] running on GCE node
I20260619 06:38:44.787190 16476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:44.789852 16476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:44.791152 16476 hybrid_clock.cc:648] HybridClock initialized: now 1781851124791092 us; error 55 us; skew 500 ppm
I20260619 06:38:44.791528 16476 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:38:44.794031 16476 webserver.cc:460] Webserver started at http://127.10.192.126:42277/ using document root <none> and password file <none>
I20260619 06:38:44.794749 16476 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:44.794842 16476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:44.795145 16476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:44.798306 16476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "73a1ae3be1284a9ab777116c65502899"
format_stamp: "Formatted at 2026-06-19 06:38:44 on dist-test-slave-7lz4"
server_key: "354f9789818c8f88567d26aa22cb349d"
server_key_iv: "9060ae47b15c0838cc87da9d667afdc2"
server_key_version: "encryptionkey@0"
I20260619 06:38:44.799144 16476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "73a1ae3be1284a9ab777116c65502899"
format_stamp: "Formatted at 2026-06-19 06:38:44 on dist-test-slave-7lz4"
server_key: "354f9789818c8f88567d26aa22cb349d"
server_key_iv: "9060ae47b15c0838cc87da9d667afdc2"
server_key_version: "encryptionkey@0"
I20260619 06:38:44.804566 16476 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.008s sys 0.000s
I20260619 06:38:44.808153 16490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:44.809612 16476 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:38:44.809806 16476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "73a1ae3be1284a9ab777116c65502899"
format_stamp: "Formatted at 2026-06-19 06:38:44 on dist-test-slave-7lz4"
server_key: "354f9789818c8f88567d26aa22cb349d"
server_key_iv: "9060ae47b15c0838cc87da9d667afdc2"
server_key_version: "encryptionkey@0"
I20260619 06:38:44.810034 16476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:44.836910 16476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:44.837817 16476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:44.838145 16476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:44.857178 16476 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:40671
I20260619 06:38:44.857199 16541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:40671 every 8 connection(s)
I20260619 06:38:44.858829 16476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:38:44.862712 16542 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:44.867799 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 16476
I20260619 06:38:44.867981 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:38:44.868618 11009 external_mini_cluster.cc:1428] Setting key 1f65bda3aba6a5a27c570c8008e11eb7
I20260619 06:38:44.874691 16542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899: Bootstrap starting.
I20260619 06:38:44.878561 16542 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:44.879817 16542 log.cc:824] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:44.883523 16542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899: No bootstrap required, opened a new log
I20260619 06:38:44.884733 16545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:44.870579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40492 (local address 127.10.192.126:40671)
0619 06:38:44.871733 (+ 1154us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:44.871753 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:44.871803 (+ 50us) server_negotiation.cc:407] Connection header received
0619 06:38:44.874112 (+ 2309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:44.874141 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:44.874753 (+ 612us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:44.875200 (+ 447us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:44.875740 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:44.877776 (+ 2036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:44.879249 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:44.880386 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:44.880607 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:44.881860 (+ 1253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:44.881872 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:44.881894 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:38:44.882616 (+ 722us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:44.882714 (+ 98us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:38:44.882738 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:44.882850 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:44.883085 (+ 235us) server_negotiation.cc:299] Negotiation successful
0619 06:38:44.883411 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":587,"thread_start_us":362,"threads_started":1}
I20260619 06:38:44.888747 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:38:44.892815 16542 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73a1ae3be1284a9ab777116c65502899" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40671 } }
I20260619 06:38:44.893168 16542 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:44.893241 16542 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a1ae3be1284a9ab777116c65502899, State: Initialized, Role: FOLLOWER
I20260619 06:38:44.893738 16542 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73a1ae3be1284a9ab777116c65502899" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40671 } }
I20260619 06:38:44.893929 16542 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:38:44.894021 16542 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:38:44.894143 16542 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:44.896315 16542 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73a1ae3be1284a9ab777116c65502899" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40671 } }
I20260619 06:38:44.896895 16542 leader_election.cc:302] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73a1ae3be1284a9ab777116c65502899; no voters:
I20260619 06:38:44.897497 16542 leader_election.cc:288] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:38:44.897667 16547 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:44.898417 16547 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899 [term 1 LEADER]: Becoming Leader. State: Replica: 73a1ae3be1284a9ab777116c65502899, State: Running, Role: LEADER
I20260619 06:38:44.898979 16547 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73a1ae3be1284a9ab777116c65502899" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40671 } }
I20260619 06:38:44.899608 16542 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:38:44.901942 16548 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73a1ae3be1284a9ab777116c65502899" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73a1ae3be1284a9ab777116c65502899" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40671 } } }
I20260619 06:38:44.902451 16549 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73a1ae3be1284a9ab777116c65502899. Latest consensus state: current_term: 1 leader_uuid: "73a1ae3be1284a9ab777116c65502899" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73a1ae3be1284a9ab777116c65502899" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40671 } } }
I20260619 06:38:44.902824 16549 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:44.902443 16548 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:44.904057 16553 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:38:44.909488 16553 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:38:44.918530 16553 catalog_manager.cc:1347] Generated new cluster ID: 7d7201e582f14a9298c5d274a57bd432
I20260619 06:38:44.918645 16553 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:38:44.961678 16553 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:38:44.963058 16553 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:38:44.974709 16553 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73a1ae3be1284a9ab777116c65502899: Generated new TSK 0
I20260619 06:38:44.975836 16553 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:38:45.521400 16545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:45.005919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40494 (local address 127.10.192.126:40671)
0619 06:38:45.006184 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:45.006194 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:45.006655 (+ 461us) server_negotiation.cc:407] Connection header received
0619 06:38:45.006953 (+ 298us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:45.006958 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:45.007044 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:45.007191 (+ 147us) server_negotiation.cc:226] Negotiated authn=JWT
0619 06:38:45.007820 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:45.008569 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:45.010677 (+ 2108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:45.011109 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:45.011203 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:45.011829 (+ 626us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0619 06:38:45.520796 (+508967us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0619 06:38:45.521181 (+ 385us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40494: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":96}
W20260619 06:38:45.521579 16545 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40494: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260619 06:38:45.521816 16571 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:38:45.005877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:40671 (local address 127.0.0.1:40494)
0619 06:38:45.006490 (+ 613us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:45.006510 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:45.006685 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:45.007246 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:45.007251 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:45.007265 (+ 14us) client_negotiation.cc:189] Negotiated authn=JWT
0619 06:38:45.007615 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:45.007652 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:45.008730 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:45.008736 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:45.010532 (+ 1796us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:45.010547 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:45.011279 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:45.011285 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:45.011481 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:45.011529 (+ 48us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0619 06:38:45.521133 (+509604us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0619 06:38:45.521428 (+ 295us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.10.192.126:40671: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":456,"thread_start_us":316,"threads_started":1}
I20260619 06:38:45.523137 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 16476
I20260619 06:38:45.524310 16537 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:45.625104 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 16476
2026-06-19T06:38:45Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1270 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (409 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (409 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:38:46 dist-test-slave-7lz4 krb5kdc[16586](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:38:46 dist-test-slave-7lz4 krb5kdc[16586](info): set up 2 sockets
Jun 19 06:38:46 dist-test-slave-7lz4 krb5kdc[16586](info): commencing operation
krb5kdc: starting...
W20260619 06:38:47.540467 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.003s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:38:47 dist-test-slave-7lz4 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851127, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:38:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:38:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:38:47.751696 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:39319
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:39319
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:48.087154 16599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:48.087489 16599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:48.087678 16599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:48.095100 16599 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:38:48.095228 16599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:48.095352 16599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:48.095453 16599 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:38:48.095521 16599 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:38:48.106808 16599 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:39319
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:39319
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:48.108234 16599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:48.109714 16599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:48.122380 16607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:48.122514 16605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:48.122987 16604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:48.124429 16599 server_base.cc:1034] running on GCE node
I20260619 06:38:48.125332 16599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:48.126860 16599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:48.128099 16599 hybrid_clock.cc:648] HybridClock initialized: now 1781851128128032 us; error 43 us; skew 500 ppm
I20260619 06:38:48.128667 16599 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:48 dist-test-slave-7lz4 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851128, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:48.132071 16599 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:38:48.133701 16599 webserver.cc:460] Webserver started at http://127.10.192.126:46259/ using document root <none> and password file <none>
I20260619 06:38:48.134446 16599 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:48.134598 16599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:48.134925 16599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:48.138085 16599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "56bd45b0f48a411c904b3be6045207a3"
format_stamp: "Formatted at 2026-06-19 06:38:48 on dist-test-slave-7lz4"
server_key: "c67e17d0388c2decde43d4a741105848"
server_key_iv: "56072f123d3a08a1e36b0992ea01a759"
server_key_version: "encryptionkey@0"
I20260619 06:38:48.138923 16599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "56bd45b0f48a411c904b3be6045207a3"
format_stamp: "Formatted at 2026-06-19 06:38:48 on dist-test-slave-7lz4"
server_key: "c67e17d0388c2decde43d4a741105848"
server_key_iv: "56072f123d3a08a1e36b0992ea01a759"
server_key_version: "encryptionkey@0"
I20260619 06:38:48.144371 16599 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 06:38:48.148142 16614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:48.149638 16599 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:38:48.149856 16599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "56bd45b0f48a411c904b3be6045207a3"
format_stamp: "Formatted at 2026-06-19 06:38:48 on dist-test-slave-7lz4"
server_key: "c67e17d0388c2decde43d4a741105848"
server_key_iv: "56072f123d3a08a1e36b0992ea01a759"
server_key_version: "encryptionkey@0"
I20260619 06:38:48.150074 16599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:48.166683 16599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:48.171425 16599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:48.171821 16599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:48.190222 16599 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:39319
I20260619 06:38:48.190240 16665 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:39319 every 8 connection(s)
I20260619 06:38:48.191812 16599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:38:48.192533 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 16599
I20260619 06:38:48.192759 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:38:48.193624 11009 external_mini_cluster.cc:1428] Setting key ec543dfa12a607c6f469fe8d6b3a7262
I20260619 06:38:48.196794 16666 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Jun 19 06:38:48 dist-test-slave-7lz4 krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851127, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:48.207527 16666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3: Bootstrap starting.
I20260619 06:38:48.211071 16666 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:48.212225 16666 log.cc:824] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:48.215620 16666 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3: No bootstrap required, opened a new log
I20260619 06:38:48.216142 16669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:48.195758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40774 (local address 127.10.192.126:39319)
0619 06:38:48.196482 (+ 724us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:48.196494 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:48.196534 (+ 40us) server_negotiation.cc:407] Connection header received
0619 06:38:48.198374 (+ 1840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:48.198396 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:48.198788 (+ 392us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:48.199186 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:48.200638 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:48.201984 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:48.203205 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:48.203960 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:48.204153 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:48.208237 (+ 4084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:48.208245 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:48.208261 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:48.208301 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:48.211416 (+ 3115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:48.212196 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:48.212203 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:48.212210 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:48.212412 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:48.212905 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:48.212916 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:48.212924 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:48.213570 (+ 646us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:48.213858 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:48.214268 (+ 410us) server_negotiation.cc:299] Negotiation successful
0619 06:38:48.214721 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":307,"threads_started":1}
I20260619 06:38:48.223869 16666 raft_consensus.cc:348] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56bd45b0f48a411c904b3be6045207a3" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39319 } }
I20260619 06:38:48.224231 16666 raft_consensus.cc:374] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:48.224294 16666 raft_consensus.cc:729] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56bd45b0f48a411c904b3be6045207a3, State: Initialized, Role: FOLLOWER
I20260619 06:38:48.224949 16666 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56bd45b0f48a411c904b3be6045207a3" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39319 } }
I20260619 06:38:48.225251 16666 raft_consensus.cc:388] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:38:48.225418 16666 raft_consensus.cc:482] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:38:48.225632 16666 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:48.227897 16666 raft_consensus.cc:504] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56bd45b0f48a411c904b3be6045207a3" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39319 } }
I20260619 06:38:48.228452 16666 leader_election.cc:302] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56bd45b0f48a411c904b3be6045207a3; no voters:
I20260619 06:38:48.229192 16666 leader_election.cc:288] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:38:48.229322 16671 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:48.230022 16671 raft_consensus.cc:686] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3 [term 1 LEADER]: Becoming Leader. State: Replica: 56bd45b0f48a411c904b3be6045207a3, State: Running, Role: LEADER
I20260619 06:38:48.230553 16671 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56bd45b0f48a411c904b3be6045207a3" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39319 } }
I20260619 06:38:48.231323 16666 sys_catalog.cc:564] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:38:48.233242 16672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56bd45b0f48a411c904b3be6045207a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56bd45b0f48a411c904b3be6045207a3" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39319 } } }
I20260619 06:38:48.233412 16673 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56bd45b0f48a411c904b3be6045207a3. Latest consensus state: current_term: 1 leader_uuid: "56bd45b0f48a411c904b3be6045207a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56bd45b0f48a411c904b3be6045207a3" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39319 } } }
I20260619 06:38:48.233680 16672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:48.234603 16678 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:38:48.233680 16673 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3 [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:48.241040 16678 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:38:48.250118 16678 catalog_manager.cc:1347] Generated new cluster ID: 5d91092a2ccc420ea2bbec48025dd98a
I20260619 06:38:48.250252 16678 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:38:48.273882 16678 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:38:48.275244 16678 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:38:48.287956 16678 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 56bd45b0f48a411c904b3be6045207a3: Generated new TSK 0
I20260619 06:38:48.288898 16678 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
I20260619 06:38:48.348107 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39319
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:48.716826 16692 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:48.717145 16692 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:48.717306 16692 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:48.724969 16692 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:48.725096 16692 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:48.725268 16692 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:38:48.735971 16692 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:48.737367 16692 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:48.738736 16692 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:48.752143 16697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:48.752197 16698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:48.752596 16700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:48.752835 16692 server_base.cc:1034] running on GCE node
I20260619 06:38:48.753765 16692 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:48.754809 16692 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:48.756049 16692 hybrid_clock.cc:648] HybridClock initialized: now 1781851128755993 us; error 40 us; skew 500 ppm
I20260619 06:38:48.756398 16692 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:48 dist-test-slave-7lz4 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851128, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:48.763707 16692 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:38:48.765198 16692 webserver.cc:460] Webserver started at http://127.10.192.65:40349/ using document root <none> and password file <none>
I20260619 06:38:48.765952 16692 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:48.766101 16692 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:48.766449 16692 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:48.769496 16692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "1bae55f0c49e4de3af5d9c0b27d1a740"
format_stamp: "Formatted at 2026-06-19 06:38:48 on dist-test-slave-7lz4"
server_key: "6a77c18951bf21f83420bd033699db3e"
server_key_iv: "2530e4d520eeb2ace873a5749998e911"
server_key_version: "encryptionkey@0"
I20260619 06:38:48.770301 16692 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "1bae55f0c49e4de3af5d9c0b27d1a740"
format_stamp: "Formatted at 2026-06-19 06:38:48 on dist-test-slave-7lz4"
server_key: "6a77c18951bf21f83420bd033699db3e"
server_key_iv: "2530e4d520eeb2ace873a5749998e911"
server_key_version: "encryptionkey@0"
I20260619 06:38:48.775771 16692 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260619 06:38:48.779801 16707 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:48.781280 16692 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:38:48.781440 16692 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "1bae55f0c49e4de3af5d9c0b27d1a740"
format_stamp: "Formatted at 2026-06-19 06:38:48 on dist-test-slave-7lz4"
server_key: "6a77c18951bf21f83420bd033699db3e"
server_key_iv: "2530e4d520eeb2ace873a5749998e911"
server_key_version: "encryptionkey@0"
I20260619 06:38:48.781612 16692 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:48.799621 16692 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:48.804008 16692 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:48.804315 16692 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:48.805277 16692 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:48.806658 16692 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:48.806730 16692 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:48.806890 16692 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:48.806951 16692 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:48.840513 16692 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:43287
I20260619 06:38:48.840554 16819 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:43287 every 8 connection(s)
I20260619 06:38:48.841869 16692 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:38:48.842573 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 16692
I20260619 06:38:48.842784 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:38:48.843608 11009 external_mini_cluster.cc:1428] Setting key 405deba37b950bd21e0a97291cb3f114
Jun 19 06:38:48 dist-test-slave-7lz4 krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851128, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.192.66@KRBTEST.COM; defaulting to no policy
I20260619 06:38:48.867031 16822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:48.844800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:36211 (local address 127.10.192.126:39319)
0619 06:38:48.845279 (+ 479us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:48.845285 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:48.846613 (+ 1328us) server_negotiation.cc:407] Connection header received
0619 06:38:48.849635 (+ 3022us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:48.849640 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:48.849710 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:48.849805 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:48.852100 (+ 2295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:48.852819 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:48.855071 (+ 2252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:48.855879 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:48.856029 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:48.859784 (+ 3755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:48.859793 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:48.859801 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:48.859848 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:48.863565 (+ 3717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:48.864376 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:48.864383 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:48.864388 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:48.864548 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:48.864976 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:48.864984 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:48.864990 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:48.865415 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:48.865582 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:48.866317 (+ 735us) server_negotiation.cc:299] Negotiation successful
0619 06:38:48.866600 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":238,"threads_started":1}
I20260619 06:38:48.867969 16823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:48.845538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39319 (local address 127.10.192.65:36211)
0619 06:38:48.846408 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:48.846476 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:48.849309 (+ 2833us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:48.850117 (+ 808us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:48.850133 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:48.850984 (+ 851us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:48.851897 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:48.851927 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:48.853007 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:48.853013 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:48.854932 (+ 1919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:48.854945 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:48.856099 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:48.856103 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:48.856305 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:48.857038 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:48.857064 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:48.859504 (+ 2440us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:48.863758 (+ 4254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:48.863765 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:48.863780 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:48.864234 (+ 454us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:48.864666 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:48.864669 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:48.864671 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:48.864861 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:48.865548 (+ 687us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:48.865554 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:48.865907 (+ 353us) client_negotiation.cc:769] Sending connection context
0619 06:38:48.866148 (+ 241us) client_negotiation.cc:240] Negotiation successful
0619 06:38:48.866575 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":541,"thread_start_us":313,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.66@KRBTEST.COM" created.
I20260619 06:38:48.869697 16820 heartbeater.cc:347] Connected to a master server at 127.10.192.126:39319
I20260619 06:38:48.869998 16820 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:48.870955 16820 heartbeater.cc:511] Master 127.10.192.126:39319 requested a full tablet report, sending...
I20260619 06:38:48.873721 16631 ts_manager.cc:194] Registered new tserver with Master: 1bae55f0c49e4de3af5d9c0b27d1a740 (127.10.192.65:43287)
I20260619 06:38:48.875962 16631 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:36211
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
I20260619 06:38:48.898936 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39319
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:49.236974 16826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:49.237274 16826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:49.237427 16826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:49.244968 16826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:49.245097 16826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:49.245296 16826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:38:49.255415 16826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:49.256825 16826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:49.258224 16826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:49.271853 16831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:49.271936 16834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:49.271896 16832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:49.272912 16826 server_base.cc:1034] running on GCE node
I20260619 06:38:49.273530 16826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:49.274585 16826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:49.275799 16826 hybrid_clock.cc:648] HybridClock initialized: now 1781851129275756 us; error 32 us; skew 500 ppm
I20260619 06:38:49.276168 16826 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:49 dist-test-slave-7lz4 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851129, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:49.279528 16826 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:38:49.281203 16826 webserver.cc:460] Webserver started at http://127.10.192.66:35665/ using document root <none> and password file <none>
I20260619 06:38:49.281934 16826 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:49.282070 16826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:49.282407 16826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:49.285583 16826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "e198056235964a83a2cef155af00d21c"
format_stamp: "Formatted at 2026-06-19 06:38:49 on dist-test-slave-7lz4"
server_key: "de934d9f65db51e801b1d575c600ed17"
server_key_iv: "4033de816c15bdc82902f748204b362f"
server_key_version: "encryptionkey@0"
I20260619 06:38:49.286475 16826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "e198056235964a83a2cef155af00d21c"
format_stamp: "Formatted at 2026-06-19 06:38:49 on dist-test-slave-7lz4"
server_key: "de934d9f65db51e801b1d575c600ed17"
server_key_iv: "4033de816c15bdc82902f748204b362f"
server_key_version: "encryptionkey@0"
I20260619 06:38:49.291960 16826 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260619 06:38:49.295528 16841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:49.296981 16826 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:38:49.297166 16826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "e198056235964a83a2cef155af00d21c"
format_stamp: "Formatted at 2026-06-19 06:38:49 on dist-test-slave-7lz4"
server_key: "de934d9f65db51e801b1d575c600ed17"
server_key_iv: "4033de816c15bdc82902f748204b362f"
server_key_version: "encryptionkey@0"
I20260619 06:38:49.297428 16826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:49.311268 16826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:49.315347 16826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:49.315671 16826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:49.316633 16826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:49.317973 16826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:49.318061 16826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:49.318228 16826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:49.318281 16826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:49.351910 16826 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:45823
I20260619 06:38:49.351950 16953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:45823 every 8 connection(s)
I20260619 06:38:49.353298 16826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:38:49.360004 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 16826
I20260619 06:38:49.360195 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:38:49.360788 11009 external_mini_cluster.cc:1428] Setting key f4b967b54ff17bc22b9bff5fec2ac73d
Jun 19 06:38:49 dist-test-slave-7lz4 krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851129, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:49.377944 16822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:49.355969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:35237 (local address 127.10.192.126:39319)
0619 06:38:49.356182 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:49.356188 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:49.357513 (+ 1325us) server_negotiation.cc:407] Connection header received
0619 06:38:49.359252 (+ 1739us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:49.359257 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:49.359350 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:49.359447 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:49.361739 (+ 2292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:49.362769 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:49.365408 (+ 2639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:49.365837 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:49.365965 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:49.370406 (+ 4441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:49.370415 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:49.370420 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:49.370469 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:49.374280 (+ 3811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:49.375180 (+ 900us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:49.375185 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:49.375188 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:49.375438 (+ 250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:49.376144 (+ 706us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:49.376149 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:49.376153 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:49.376454 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:49.376612 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:49.377350 (+ 738us) server_negotiation.cc:299] Negotiation successful
0619 06:38:49.377592 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260619 06:38:49.379132 16956 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:49.356605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39319 (local address 127.10.192.66:35237)
0619 06:38:49.357339 (+ 734us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:49.357391 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:49.358999 (+ 1608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:49.359872 (+ 873us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:49.359884 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:49.360672 (+ 788us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:49.361523 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:49.361545 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:49.362942 (+ 1397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:49.362947 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:49.365240 (+ 2293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:49.365265 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:49.366074 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:49.366082 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:49.366422 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:49.367183 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:49.367218 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:49.370126 (+ 2908us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:49.374476 (+ 4350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:49.374484 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:49.374500 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:49.374955 (+ 455us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:49.375579 (+ 624us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:49.375586 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:49.375591 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:49.376015 (+ 424us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:49.376597 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:49.376606 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:49.376976 (+ 370us) client_negotiation.cc:769] Sending connection context
0619 06:38:49.377243 (+ 267us) client_negotiation.cc:240] Negotiation successful
0619 06:38:49.377824 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":299,"threads_started":1}
I20260619 06:38:49.380872 16954 heartbeater.cc:347] Connected to a master server at 127.10.192.126:39319
I20260619 06:38:49.381203 16954 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:49.381968 16954 heartbeater.cc:511] Master 127.10.192.126:39319 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.192.67@KRBTEST.COM; defaulting to no policy
I20260619 06:38:49.383615 16631 ts_manager.cc:194] Registered new tserver with Master: e198056235964a83a2cef155af00d21c (127.10.192.66:45823)
I20260619 06:38:49.384539 16631 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:35237
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
I20260619 06:38:49.411229 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39319
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:49.742632 16959 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:49.742985 16959 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:49.743165 16959 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:49.750744 16959 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:49.750921 16959 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:49.751128 16959 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:38:49.761411 16959 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39319
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:49.762784 16959 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:49.764246 16959 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:49.777694 16965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:49.777726 16964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:49.777778 16967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:49.778679 16959 server_base.cc:1034] running on GCE node
I20260619 06:38:49.779239 16959 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:49.780385 16959 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:49.781615 16959 hybrid_clock.cc:648] HybridClock initialized: now 1781851129781552 us; error 63 us; skew 500 ppm
I20260619 06:38:49.781944 16959 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:49 dist-test-slave-7lz4 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851129, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:49.785131 16959 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:38:49.786753 16959 webserver.cc:460] Webserver started at http://127.10.192.67:33997/ using document root <none> and password file <none>
I20260619 06:38:49.787462 16959 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:49.787595 16959 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:49.787986 16959 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:49.790979 16959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "1ecc1bc071f348daacf6c48a3e2439e5"
format_stamp: "Formatted at 2026-06-19 06:38:49 on dist-test-slave-7lz4"
server_key: "042102d4f7c54129e126e94f0d2541b2"
server_key_iv: "b672244ec6a58c916406dc9a5a265b7d"
server_key_version: "encryptionkey@0"
I20260619 06:38:49.791965 16959 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "1ecc1bc071f348daacf6c48a3e2439e5"
format_stamp: "Formatted at 2026-06-19 06:38:49 on dist-test-slave-7lz4"
server_key: "042102d4f7c54129e126e94f0d2541b2"
server_key_iv: "b672244ec6a58c916406dc9a5a265b7d"
server_key_version: "encryptionkey@0"
I20260619 06:38:49.797421 16959 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 06:38:49.801254 16974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:49.802840 16959 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:38:49.803020 16959 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "1ecc1bc071f348daacf6c48a3e2439e5"
format_stamp: "Formatted at 2026-06-19 06:38:49 on dist-test-slave-7lz4"
server_key: "042102d4f7c54129e126e94f0d2541b2"
server_key_iv: "b672244ec6a58c916406dc9a5a265b7d"
server_key_version: "encryptionkey@0"
I20260619 06:38:49.803237 16959 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:49.842254 16959 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:49.846848 16959 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:49.847173 16959 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:49.848217 16959 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:49.849603 16959 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:49.849712 16959 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:49.849865 16959 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:49.849942 16959 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:49.880115 16820 heartbeater.cc:503] Master 127.10.192.126:39319 was elected leader, sending a full tablet report...
I20260619 06:38:49.890096 16959 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:35885
I20260619 06:38:49.890152 17086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:35885 every 8 connection(s)
I20260619 06:38:49.891489 16959 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:38:49.893045 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 16959
I20260619 06:38:49.893234 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:38:49.893858 11009 external_mini_cluster.cc:1428] Setting key 2e0b28feddef6b03cb0cc365270f6b98
Jun 19 06:38:49 dist-test-slave-7lz4 krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851129, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:38:49.913535 17089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:49.894511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:49729 (local address 127.10.192.126:39319)
0619 06:38:49.895310 (+ 799us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:49.895317 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:49.896359 (+ 1042us) server_negotiation.cc:407] Connection header received
0619 06:38:49.898239 (+ 1880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:49.898243 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:49.898315 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:49.898413 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:49.900026 (+ 1613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:49.900799 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:49.902676 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:49.903086 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:49.903184 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:49.906681 (+ 3497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:49.906686 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:49.906689 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:49.906783 (+ 94us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:49.910229 (+ 3446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:49.911035 (+ 806us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:49.911040 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:49.911043 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:49.911177 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:49.911766 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:49.911779 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:49.911782 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:49.912094 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:49.912218 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:49.913066 (+ 848us) server_negotiation.cc:299] Negotiation successful
0619 06:38:49.913240 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":634,"thread_start_us":526,"threads_started":1}
I20260619 06:38:49.914605 17090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:49.895320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39319 (local address 127.10.192.67:49729)
0619 06:38:49.896201 (+ 881us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:49.896254 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:49.897961 (+ 1707us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:49.898620 (+ 659us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:49.898629 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:49.899159 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:49.899822 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:49.899841 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:49.900956 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:49.900960 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:49.902528 (+ 1568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:49.902541 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:49.903287 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:49.903292 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:49.903503 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:49.904209 (+ 706us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:49.904232 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:49.906406 (+ 2174us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:49.910387 (+ 3981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:49.910395 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:49.910409 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:49.910866 (+ 457us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:49.911314 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:49.911318 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:49.911321 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:49.911547 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:49.912225 (+ 678us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:49.912232 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:49.912662 (+ 430us) client_negotiation.cc:769] Sending connection context
0619 06:38:49.912914 (+ 252us) client_negotiation.cc:240] Negotiation successful
0619 06:38:49.913339 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"thread_start_us":383,"threads_started":1}
I20260619 06:38:49.916142 17087 heartbeater.cc:347] Connected to a master server at 127.10.192.126:39319
I20260619 06:38:49.916519 17087 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:49.917263 17087 heartbeater.cc:511] Master 127.10.192.126:39319 requested a full tablet report, sending...
I20260619 06:38:49.918744 16631 ts_manager.cc:194] Registered new tserver with Master: 1ecc1bc071f348daacf6c48a3e2439e5 (127.10.192.67:35885)
I20260619 06:38:49.919593 16631 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:49729
I20260619 06:38:49.922377 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/test-admin.keytab.
Jun 19 06:38:49 dist-test-slave-7lz4 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:49.949018 11009 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260619 06:38:49.954347 17095 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:38:49.951665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34334 (local address 127.10.192.65:43287)
0619 06:38:49.952358 (+ 693us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:49.952372 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:49.952397 (+ 25us) server_negotiation.cc:407] Connection header received
0619 06:38:49.952456 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:49.952462 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:49.952679 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:49.952858 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:49.953922 (+ 1064us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34334: BlockingRecv error: recv got EOF from 127.0.0.1:34334 (error 108)
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":338,"threads_started":1}
W20260619 06:38:49.954522 11009 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/krb5cc' of type FILE
Jun 19 06:38:49 dist-test-slave-7lz4 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:49.956240 11009 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Jun 19 06:38:49 dist-test-slave-7lz4 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:49.957675 11009 init.cc:295] Successfully reacquired a new kerberos TGT
Jun 19 06:38:49 dist-test-slave-7lz4 krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:38:49.973963 17095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:49.959584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34342 (local address 127.10.192.65:43287)
0619 06:38:49.959811 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:49.959819 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:49.959952 (+ 133us) server_negotiation.cc:407] Connection header received
0619 06:38:49.960149 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:49.960153 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:49.960219 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:49.960356 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:49.961409 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:49.962406 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:49.963733 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:49.964315 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:49.964416 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:49.968360 (+ 3944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:49.968374 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:49.968390 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:49.968428 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:49.971190 (+ 2762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:49.972102 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:49.972110 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:49.972112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:49.972240 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:49.972622 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:49.972625 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:49.972627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:49.972989 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:49.973202 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:49.973483 (+ 281us) server_negotiation.cc:299] Negotiation successful
0619 06:38:49.973693 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
W20260619 06:38:49.980226 17095 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:38:49.978282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34352 (local address 127.10.192.65:43287)
0619 06:38:49.978458 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:49.978463 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:49.978855 (+ 392us) server_negotiation.cc:407] Connection header received
0619 06:38:49.978989 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:49.978992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:49.979061 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:49.979143 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:49.979930 (+ 787us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34352: BlockingRecv error: recv got EOF from 127.0.0.1:34352 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
W20260619 06:38:49.980397 11009 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/krb5cc' of type FILE
Jun 19 06:38:49 dist-test-slave-7lz4 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:49.981920 11009 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Jun 19 06:38:49 dist-test-slave-7lz4 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:49.983294 11009 init.cc:295] Successfully reacquired a new kerberos TGT
Jun 19 06:38:49 dist-test-slave-7lz4 krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851129, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:38:49.998266 17095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:49.984726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34360 (local address 127.10.192.65:43287)
0619 06:38:49.984984 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:49.984992 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:49.985148 (+ 156us) server_negotiation.cc:407] Connection header received
0619 06:38:49.985279 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:49.985283 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:49.985347 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:49.985429 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:49.986476 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:49.987263 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:49.988559 (+ 1296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:49.989013 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:49.989109 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:49.992861 (+ 3752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:49.992867 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:49.992871 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:49.992924 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:49.995536 (+ 2612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:49.996290 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:49.996294 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:49.996296 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:49.996423 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:49.996913 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:49.996924 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:49.996927 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:49.997204 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:49.997422 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:49.997709 (+ 287us) server_negotiation.cc:299] Negotiation successful
0619 06:38:49.997901 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
W20260619 06:38:50.003173 17095 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:38:50.001144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34376 (local address 127.10.192.65:43287)
0619 06:38:50.001388 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:50.001394 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:50.001685 (+ 291us) server_negotiation.cc:407] Connection header received
0619 06:38:50.001878 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:50.001882 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:50.001960 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:50.002038 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:50.002923 (+ 885us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34376: BlockingRecv error: recv got EOF from 127.0.0.1:34376 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
W20260619 06:38:50.003283 11009 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1781851080573990-11009-0/krb5kdc/krb5cc' of type FILE
Jun 19 06:38:50 dist-test-slave-7lz4 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851130, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:50.004954 11009 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Jun 19 06:38:50 dist-test-slave-7lz4 krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851130, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:50.006250 11009 init.cc:295] Successfully reacquired a new kerberos TGT
Jun 19 06:38:50 dist-test-slave-7lz4 krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851130, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:38:50.020383 17095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:50.007733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34390 (local address 127.10.192.65:43287)
0619 06:38:50.007966 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:50.007972 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:50.008268 (+ 296us) server_negotiation.cc:407] Connection header received
0619 06:38:50.008368 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:50.008373 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:50.008437 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:50.008524 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:50.009381 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:50.010073 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:50.011241 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:50.011706 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:50.011808 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:50.015463 (+ 3655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:50.015468 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:50.015471 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:50.015502 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:50.017987 (+ 2485us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:50.018598 (+ 611us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:50.018602 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:50.018604 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:50.018749 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:50.019069 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:50.019073 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:50.019075 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:50.019333 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:50.019562 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:50.019828 (+ 266us) server_negotiation.cc:299] Negotiation successful
0619 06:38:50.020001 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260619 06:38:50.022081 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 16692
I20260619 06:38:50.033846 17095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:50.022726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34404 (local address 127.10.192.65:43287)
0619 06:38:50.022886 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:50.022890 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:50.023244 (+ 354us) server_negotiation.cc:407] Connection header received
0619 06:38:50.023326 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:50.023329 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:50.023385 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:50.023463 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:50.024397 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:50.025083 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:50.026252 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:50.026634 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:50.026733 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:50.028766 (+ 2033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:50.028770 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:50.028773 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:50.028803 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:50.031341 (+ 2538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:50.032062 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:50.032066 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:50.032068 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:50.032190 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:50.032610 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:50.032614 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:50.032615 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:50.032946 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:50.033138 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:50.033416 (+ 278us) server_negotiation.cc:299] Negotiation successful
0619 06:38:50.033587 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260619 06:38:50.034463 16815 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:50.119130 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 16692
I20260619 06:38:50.135123 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 16826
Jun 19 06:38:50 dist-test-slave-7lz4 krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851130, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.66@KRBTEST.COM
I20260619 06:38:50.150693 17108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:50.136034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38184 (local address 127.10.192.66:45823)
0619 06:38:50.136540 (+ 506us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:50.136548 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:50.136573 (+ 25us) server_negotiation.cc:407] Connection header received
0619 06:38:50.136632 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:50.136638 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:50.136848 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:50.137037 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:50.138004 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:50.139005 (+ 1001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:50.140350 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:50.140913 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:50.141054 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:50.144799 (+ 3745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:50.144812 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:50.144827 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:50.144863 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:50.147831 (+ 2968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:50.148568 (+ 737us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:50.148576 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:50.148578 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:50.148700 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:50.149090 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:50.149094 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:50.149097 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:50.149458 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:50.149779 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:50.150107 (+ 328us) server_negotiation.cc:299] Negotiation successful
0619 06:38:50.150375 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":242,"threads_started":1}
I20260619 06:38:50.152237 16949 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:50.242316 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 16826
I20260619 06:38:50.258090 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 16959
Jun 19 06:38:50 dist-test-slave-7lz4 krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851130, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.67@KRBTEST.COM
I20260619 06:38:50.274147 17110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:50.259095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44902 (local address 127.10.192.67:35885)
0619 06:38:50.259804 (+ 709us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:50.259811 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:50.259842 (+ 31us) server_negotiation.cc:407] Connection header received
0619 06:38:50.259903 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:50.259909 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:50.260115 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:50.260286 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:50.261327 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:50.262326 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:50.263590 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:50.264269 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:50.264413 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:50.268429 (+ 4016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:50.268440 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:50.268456 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:50.268494 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:50.271187 (+ 2693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:50.272077 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:50.272084 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:50.272087 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:50.272208 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:50.272603 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:50.272609 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:50.272612 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:50.272972 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:50.273280 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:50.273591 (+ 311us) server_negotiation.cc:299] Negotiation successful
0619 06:38:50.273851 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":509,"thread_start_us":360,"threads_started":1}
I20260619 06:38:50.275482 17082 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:50.359021 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 16959
I20260619 06:38:50.374790 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 16599
I20260619 06:38:50.376175 16661 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:50.479126 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 16599
2026-06-19T06:38:50Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (4040 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:38:50 dist-test-slave-7lz4 krb5kdc[17115](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:38:50 dist-test-slave-7lz4 krb5kdc[17115](info): set up 2 sockets
Jun 19 06:38:50 dist-test-slave-7lz4 krb5kdc[17115](info): commencing operation
krb5kdc: starting...
W20260619 06:38:51.581025 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.001s sys 0.018s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:38:51 dist-test-slave-7lz4 krb5kdc[17115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:38:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:38:51Z Disabled control of system clock
WARNING: no policy specified for oryx/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.126.keytab.
Entry for principal oryx/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.126.keytab.
I20260619 06:38:51.799603 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:33459
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.126.keytab
--principal=oryx/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:37949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:33459
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:52.142624 17128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:52.143000 17128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:52.143170 17128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:52.150519 17128 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:38:52.150691 17128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:52.150805 17128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:52.150916 17128 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:38:52.150995 17128 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:38:52.160985 17128 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:37949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:33459
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.126.keytab
--principal=oryx/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:33459
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:52.162447 17128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:52.163872 17128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:52.175691 17133 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:52.175653 17134 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:52.175717 17136 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:52.177014 17128 server_base.cc:1034] running on GCE node
I20260619 06:38:52.177829 17128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:52.179292 17128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:52.180537 17128 hybrid_clock.cc:648] HybridClock initialized: now 1781851132180505 us; error 47 us; skew 500 ppm
I20260619 06:38:52.180922 17128 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:52 dist-test-slave-7lz4 krb5kdc[17115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851132, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:52.184087 17128 init.cc:377] Logged in from keytab as oryx/127.10.192.126@KRBTEST.COM (short username oryx)
I20260619 06:38:52.185624 17128 webserver.cc:460] Webserver started at http://127.10.192.126:44075/ using document root <none> and password file <none>
I20260619 06:38:52.186342 17128 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:52.186486 17128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:52.186815 17128 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:52.189807 17128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "54987b0b55b74c9585053e4148f4635a"
format_stamp: "Formatted at 2026-06-19 06:38:52 on dist-test-slave-7lz4"
server_key: "4662b1d71cc8e12f59eaf6cc85d8ce9b"
server_key_iv: "472c20ad8b36e08413b71b8d5154522a"
server_key_version: "encryptionkey@0"
I20260619 06:38:52.190569 17128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "54987b0b55b74c9585053e4148f4635a"
format_stamp: "Formatted at 2026-06-19 06:38:52 on dist-test-slave-7lz4"
server_key: "4662b1d71cc8e12f59eaf6cc85d8ce9b"
server_key_iv: "472c20ad8b36e08413b71b8d5154522a"
server_key_version: "encryptionkey@0"
I20260619 06:38:52.195748 17128 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260619 06:38:52.199333 17143 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:52.200771 17128 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:38:52.200977 17128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "54987b0b55b74c9585053e4148f4635a"
format_stamp: "Formatted at 2026-06-19 06:38:52 on dist-test-slave-7lz4"
server_key: "4662b1d71cc8e12f59eaf6cc85d8ce9b"
server_key_iv: "472c20ad8b36e08413b71b8d5154522a"
server_key_version: "encryptionkey@0"
I20260619 06:38:52.201177 17128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:52.230827 17128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:52.235225 17128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:52.235534 17128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:52.254194 17128 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:33459
I20260619 06:38:52.254215 17194 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:33459 every 8 connection(s)
I20260619 06:38:52.255697 17128 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:38:52.259452 17195 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:52.260521 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 17128
I20260619 06:38:52.260738 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:38:52.261586 11009 external_mini_cluster.cc:1428] Setting key 6c489bfd36e2cb0573c0dce6aff2e4b1
I20260619 06:38:52.274619 17195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a: Bootstrap starting.
Jun 19 06:38:52 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM
I20260619 06:38:52.278477 17195 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:52.279809 17195 log.cc:824] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:52.282914 17195 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a: No bootstrap required, opened a new log
I20260619 06:38:52.285669 17198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:52.263818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40448 (local address 127.10.192.126:33459)
0619 06:38:52.264721 (+ 903us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:52.264733 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:52.264775 (+ 42us) server_negotiation.cc:407] Connection header received
0619 06:38:52.266353 (+ 1578us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:52.266386 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:52.266813 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:52.267161 (+ 348us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:52.269170 (+ 2009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:52.270510 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:52.272429 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:52.273172 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:52.273328 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:52.277981 (+ 4653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:52.277990 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:52.278021 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:52.278067 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:52.281343 (+ 3276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:52.282130 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:52.282138 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:52.282145 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:52.282313 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:52.282727 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:52.282737 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:52.282739 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:52.283315 (+ 576us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:52.283711 (+ 396us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:52.284152 (+ 441us) server_negotiation.cc:299] Negotiation successful
0619 06:38:52.284600 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":374,"threads_started":1}
I20260619 06:38:52.291066 17195 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } }
I20260619 06:38:52.291458 17195 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:52.291572 17195 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54987b0b55b74c9585053e4148f4635a, State: Initialized, Role: FOLLOWER
I20260619 06:38:52.292160 17195 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } }
I20260619 06:38:52.292362 17195 raft_consensus.cc:388] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:38:52.292516 17195 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:38:52.292694 17195 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:52.295158 17195 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } }
I20260619 06:38:52.295763 17195 leader_election.cc:302] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 54987b0b55b74c9585053e4148f4635a; no voters:
I20260619 06:38:52.296296 17195 leader_election.cc:288] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:38:52.296464 17200 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:52.297127 17200 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [term 1 LEADER]: Becoming Leader. State: Replica: 54987b0b55b74c9585053e4148f4635a, State: Running, Role: LEADER
I20260619 06:38:52.297657 17200 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } }
I20260619 06:38:52.298421 17195 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:38:52.301273 17201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "54987b0b55b74c9585053e4148f4635a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } }
I20260619 06:38:52.301622 17201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:52.300640 17202 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54987b0b55b74c9585053e4148f4635a. Latest consensus state: current_term: 1 leader_uuid: "54987b0b55b74c9585053e4148f4635a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } }
I20260619 06:38:52.302289 17202 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:52.312192 17209 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:38:52.316752 17209 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:38:52.325357 17209 catalog_manager.cc:1347] Generated new cluster ID: e0d8d3da0d5e4194a70beb96d7c6ec54
I20260619 06:38:52.325495 17209 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:38:52.344260 17209 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:38:52.345853 17209 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:38:52.360198 17209 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a: Generated new TSK 0
I20260619 06:38:52.361096 17209 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.65.keytab.
Entry for principal oryx/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.65.keytab.
I20260619 06:38:52.414974 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:33459
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.65.keytab
--principal=oryx/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:37949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:52.747990 17221 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:52.748296 17221 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:52.748394 17221 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:52.755703 17221 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:52.755829 17221 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:52.755956 17221 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:38:52.765764 17221 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:37949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.65.keytab
--principal=oryx/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:33459
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:52.767083 17221 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:52.768489 17221 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:52.786273 17227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:52.786428 17226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:52.787055 17221 server_base.cc:1034] running on GCE node
W20260619 06:38:52.787179 17229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:52.788015 17221 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:52.789500 17221 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:52.790827 17221 hybrid_clock.cc:648] HybridClock initialized: now 1781851132790765 us; error 61 us; skew 500 ppm
I20260619 06:38:52.791193 17221 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:52 dist-test-slave-7lz4 krb5kdc[17115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851132, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:52.795060 17221 init.cc:377] Logged in from keytab as oryx/127.10.192.65@KRBTEST.COM (short username oryx)
I20260619 06:38:52.797065 17221 webserver.cc:460] Webserver started at http://127.10.192.65:38635/ using document root <none> and password file <none>
I20260619 06:38:52.798081 17221 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:52.798269 17221 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:52.798647 17221 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:52.802764 17221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "bc6f36ed88f74d6588b1214661fc0bed"
format_stamp: "Formatted at 2026-06-19 06:38:52 on dist-test-slave-7lz4"
server_key: "a519f96f9fe3713c90c7cd000d519447"
server_key_iv: "8c26d2f235f62bfb1fdfeceb84ff2a0f"
server_key_version: "encryptionkey@0"
I20260619 06:38:52.803918 17221 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "bc6f36ed88f74d6588b1214661fc0bed"
format_stamp: "Formatted at 2026-06-19 06:38:52 on dist-test-slave-7lz4"
server_key: "a519f96f9fe3713c90c7cd000d519447"
server_key_iv: "8c26d2f235f62bfb1fdfeceb84ff2a0f"
server_key_version: "encryptionkey@0"
I20260619 06:38:52.811565 17221 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260619 06:38:52.816927 17236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:52.818862 17221 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260619 06:38:52.819123 17221 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "bc6f36ed88f74d6588b1214661fc0bed"
format_stamp: "Formatted at 2026-06-19 06:38:52 on dist-test-slave-7lz4"
server_key: "a519f96f9fe3713c90c7cd000d519447"
server_key_iv: "8c26d2f235f62bfb1fdfeceb84ff2a0f"
server_key_version: "encryptionkey@0"
I20260619 06:38:52.819468 17221 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:52.845695 17221 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:52.850051 17221 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:52.850361 17221 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:52.851382 17221 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:52.852768 17221 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:52.852856 17221 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:52.853029 17221 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:52.853091 17221 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:52.886742 17221 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:42847
I20260619 06:38:52.886788 17348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:42847 every 8 connection(s)
I20260619 06:38:52.888156 17221 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:38:52.896358 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 17221
I20260619 06:38:52.896589 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:38:52.897377 11009 external_mini_cluster.cc:1428] Setting key 8f33d345b5c95b16baede72a277bbe6d
Jun 19 06:38:52 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851132, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM
I20260619 06:38:52.911221 17351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:52.890705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:43491 (local address 127.10.192.126:33459)
0619 06:38:52.891155 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:52.891161 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:52.892232 (+ 1071us) server_negotiation.cc:407] Connection header received
0619 06:38:52.894560 (+ 2328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:52.894567 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:52.894670 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:52.894810 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:52.897132 (+ 2322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:52.897898 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:52.899888 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:52.900287 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:52.900438 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:52.904195 (+ 3757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:52.904201 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:52.904204 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:52.904237 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:52.907704 (+ 3467us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:52.908616 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:52.908624 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:52.908630 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:52.908784 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:52.909201 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:52.909209 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:52.909214 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:52.909600 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:52.909748 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:52.910486 (+ 738us) server_negotiation.cc:299] Negotiation successful
0619 06:38:52.910742 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":208,"threads_started":1}
I20260619 06:38:52.911943 17352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:52.891261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.65:43491)
0619 06:38:52.892069 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:52.892107 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:52.894261 (+ 2154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:52.895133 (+ 872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:52.895145 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:52.896001 (+ 856us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:52.896885 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:52.896914 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:52.898077 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:52.898082 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:52.899715 (+ 1633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:52.899727 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:52.900528 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:52.900539 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:52.900781 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:52.901539 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:52.901561 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:52.903929 (+ 2368us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:52.907866 (+ 3937us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:52.907874 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:52.907887 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:52.908463 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:52.908890 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:52.908893 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:52.908895 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:52.909086 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:52.909717 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:52.909723 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:52.910069 (+ 346us) client_negotiation.cc:769] Sending connection context
0619 06:38:52.910298 (+ 229us) client_negotiation.cc:240] Negotiation successful
0619 06:38:52.910709 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":355,"threads_started":1}
I20260619 06:38:52.913645 17349 heartbeater.cc:347] Connected to a master server at 127.10.192.126:33459
I20260619 06:38:52.914011 17349 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:52.914987 17349 heartbeater.cc:511] Master 127.10.192.126:33459 requested a full tablet report, sending...
I20260619 06:38:52.917398 17160 ts_manager.cc:194] Registered new tserver with Master: bc6f36ed88f74d6588b1214661fc0bed (127.10.192.65:42847)
WARNING: no policy specified for oryx/127.10.192.66@KRBTEST.COM; defaulting to no policy
I20260619 06:38:52.918951 17160 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:43491
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.192.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.66.keytab.
Entry for principal oryx/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.66.keytab.
I20260619 06:38:52.946763 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:33459
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.66.keytab
--principal=oryx/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:37949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:53.287552 17355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:53.288023 17355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:53.288213 17355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:53.296072 17355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:53.296233 17355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:53.296445 17355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:38:53.307276 17355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:37949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.66.keytab
--principal=oryx/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:33459
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:53.308751 17355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:53.310173 17355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:53.323951 17361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:53.324041 17360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:53.324056 17363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:53.324961 17355 server_base.cc:1034] running on GCE node
I20260619 06:38:53.325668 17355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:53.326728 17355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:53.327929 17355 hybrid_clock.cc:648] HybridClock initialized: now 1781851133327880 us; error 36 us; skew 500 ppm
I20260619 06:38:53.328265 17355 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:53 dist-test-slave-7lz4 krb5kdc[17115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851133, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:53.331739 17355 init.cc:377] Logged in from keytab as oryx/127.10.192.66@KRBTEST.COM (short username oryx)
I20260619 06:38:53.333316 17355 webserver.cc:460] Webserver started at http://127.10.192.66:43925/ using document root <none> and password file <none>
I20260619 06:38:53.334021 17355 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:53.334123 17355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:53.334393 17355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:53.337514 17355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "776283177ae340d790862761bc824aff"
format_stamp: "Formatted at 2026-06-19 06:38:53 on dist-test-slave-7lz4"
server_key: "ab1860661ea36cb6fc3fd355a3236b7d"
server_key_iv: "fb1727ad67aaa4da110f51f9754286be"
server_key_version: "encryptionkey@0"
I20260619 06:38:53.338310 17355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "776283177ae340d790862761bc824aff"
format_stamp: "Formatted at 2026-06-19 06:38:53 on dist-test-slave-7lz4"
server_key: "ab1860661ea36cb6fc3fd355a3236b7d"
server_key_iv: "fb1727ad67aaa4da110f51f9754286be"
server_key_version: "encryptionkey@0"
I20260619 06:38:53.343851 17355 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260619 06:38:53.347733 17370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:53.349254 17355 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:38:53.349488 17355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "776283177ae340d790862761bc824aff"
format_stamp: "Formatted at 2026-06-19 06:38:53 on dist-test-slave-7lz4"
server_key: "ab1860661ea36cb6fc3fd355a3236b7d"
server_key_iv: "fb1727ad67aaa4da110f51f9754286be"
server_key_version: "encryptionkey@0"
I20260619 06:38:53.349710 17355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:53.372864 17355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:53.377350 17355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:53.377674 17355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:53.378772 17355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:53.380205 17355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:53.380285 17355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:53.380468 17355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:53.380518 17355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:53.414808 17355 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:41223
I20260619 06:38:53.414862 17482 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:41223 every 8 connection(s)
I20260619 06:38:53.416227 17355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:38:53.418533 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 17355
I20260619 06:38:53.418720 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:38:53.419283 11009 external_mini_cluster.cc:1428] Setting key 81324a4c3489469cd615f97f89094157
Jun 19 06:38:53 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851133, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM
I20260619 06:38:53.440734 17485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:53.418963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:58589 (local address 127.10.192.126:33459)
0619 06:38:53.419465 (+ 502us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:53.419469 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:53.420744 (+ 1275us) server_negotiation.cc:407] Connection header received
0619 06:38:53.422827 (+ 2083us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:53.422832 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:53.422919 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:53.423051 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:53.424794 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:53.425982 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:53.427820 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:53.428227 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:53.428335 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:53.432866 (+ 4531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:53.432875 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:53.432883 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:53.432932 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:53.436699 (+ 3767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:53.437813 (+ 1114us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:53.437823 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:53.437829 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:53.438020 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:53.438521 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:53.438529 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:53.438535 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:53.438957 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:53.439129 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:53.440024 (+ 895us) server_negotiation.cc:299] Negotiation successful
0619 06:38:53.440289 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":237,"threads_started":1}
I20260619 06:38:53.441546 17486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:53.419611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.66:58589)
0619 06:38:53.420555 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:53.420614 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:53.422545 (+ 1931us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:53.423298 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:53.423307 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:53.423929 (+ 622us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:53.424536 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:53.424555 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:53.426151 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:53.426154 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:53.427662 (+ 1508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:53.427682 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:53.428483 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:53.428493 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:53.428834 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:53.429647 (+ 813us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:53.429682 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:53.432575 (+ 2893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:53.436921 (+ 4346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:53.436931 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:53.436947 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:53.437627 (+ 680us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:53.438148 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:53.438151 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:53.438154 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:53.438375 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:53.439101 (+ 726us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:53.439108 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:53.439494 (+ 386us) client_negotiation.cc:769] Sending connection context
0619 06:38:53.439852 (+ 358us) client_negotiation.cc:240] Negotiation successful
0619 06:38:53.440298 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":612,"thread_start_us":347,"threads_started":1}
WARNING: no policy specified for oryx/127.10.192.67@KRBTEST.COM; defaulting to no policy
I20260619 06:38:53.443147 17483 heartbeater.cc:347] Connected to a master server at 127.10.192.126:33459
I20260619 06:38:53.443503 17483 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.192.67@KRBTEST.COM" created.
I20260619 06:38:53.444460 17483 heartbeater.cc:511] Master 127.10.192.126:33459 requested a full tablet report, sending...
I20260619 06:38:53.446054 17160 ts_manager.cc:194] Registered new tserver with Master: 776283177ae340d790862761bc824aff (127.10.192.66:41223)
I20260619 06:38:53.446858 17160 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:58589
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.67.keytab.
Entry for principal oryx/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.67.keytab.
I20260619 06:38:53.470213 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:33459
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.67.keytab
--principal=oryx/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:37949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:53.798454 17489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:53.798750 17489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:53.798942 17489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:53.806607 17489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:53.806736 17489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:53.806952 17489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:38:53.817380 17489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:37949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.67.keytab
--principal=oryx/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:33459
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:53.818950 17489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:53.820323 17489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:53.834162 17494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:53.834146 17495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:53.834192 17497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:53.834934 17489 server_base.cc:1034] running on GCE node
I20260619 06:38:53.835539 17489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:53.836627 17489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:53.837874 17489 hybrid_clock.cc:648] HybridClock initialized: now 1781851133837823 us; error 41 us; skew 500 ppm
I20260619 06:38:53.838240 17489 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:53 dist-test-slave-7lz4 krb5kdc[17115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851133, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:53.845693 17489 init.cc:377] Logged in from keytab as oryx/127.10.192.67@KRBTEST.COM (short username oryx)
I20260619 06:38:53.847332 17489 webserver.cc:460] Webserver started at http://127.10.192.67:34953/ using document root <none> and password file <none>
I20260619 06:38:53.848112 17489 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:53.848220 17489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:53.848490 17489 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:53.851431 17489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "40d10e23a819488ab3a62103a775c085"
format_stamp: "Formatted at 2026-06-19 06:38:53 on dist-test-slave-7lz4"
server_key: "953ccf16cfc68745a6006c613b13ad24"
server_key_iv: "bbb2ed4fb90f23dd5f41bee3e170341a"
server_key_version: "encryptionkey@0"
I20260619 06:38:53.852257 17489 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "40d10e23a819488ab3a62103a775c085"
format_stamp: "Formatted at 2026-06-19 06:38:53 on dist-test-slave-7lz4"
server_key: "953ccf16cfc68745a6006c613b13ad24"
server_key_iv: "bbb2ed4fb90f23dd5f41bee3e170341a"
server_key_version: "encryptionkey@0"
I20260619 06:38:53.857738 17489 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 06:38:53.861223 17504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:53.862591 17489 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 06:38:53.862766 17489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "40d10e23a819488ab3a62103a775c085"
format_stamp: "Formatted at 2026-06-19 06:38:53 on dist-test-slave-7lz4"
server_key: "953ccf16cfc68745a6006c613b13ad24"
server_key_iv: "bbb2ed4fb90f23dd5f41bee3e170341a"
server_key_version: "encryptionkey@0"
I20260619 06:38:53.862982 17489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:53.896801 17489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:53.902341 17489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:53.902666 17489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:53.903765 17489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:53.905232 17489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:53.905320 17489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:53.905473 17489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:53.905527 17489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:53.922465 17349 heartbeater.cc:503] Master 127.10.192.126:33459 was elected leader, sending a full tablet report...
I20260619 06:38:53.938769 17489 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:35425
I20260619 06:38:53.938807 17616 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:35425 every 8 connection(s)
I20260619 06:38:53.940173 17489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:38:53.941684 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 17489
I20260619 06:38:53.941864 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:38:53.942407 11009 external_mini_cluster.cc:1428] Setting key bf16e53ce5ecad6f8c2a464b1139870e
Jun 19 06:38:53 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851133, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM
I20260619 06:38:53.960704 17619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:53.943030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:38433 (local address 127.10.192.126:33459)
0619 06:38:53.943425 (+ 395us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:53.943430 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:53.944722 (+ 1292us) server_negotiation.cc:407] Connection header received
0619 06:38:53.946518 (+ 1796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:53.946521 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:53.946597 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:53.946688 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:53.948258 (+ 1570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:53.949014 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:53.950534 (+ 1520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:53.950914 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:53.951003 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:53.954606 (+ 3603us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:53.954611 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:53.954614 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:53.954648 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:53.957628 (+ 2980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:53.958490 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:53.958494 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:53.958496 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:53.958616 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:53.959066 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:53.959070 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:53.959072 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:53.959344 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:53.959474 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:53.960251 (+ 777us) server_negotiation.cc:299] Negotiation successful
0619 06:38:53.960420 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":288,"thread_start_us":186,"threads_started":1}
I20260619 06:38:53.961742 17620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:53.943716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.67:38433)
0619 06:38:53.944554 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:53.944607 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:53.946273 (+ 1666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:53.946921 (+ 648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:53.946930 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:53.947439 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:53.948114 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:53.948132 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:53.949152 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:53.949156 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:53.950411 (+ 1255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:53.950422 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:53.951101 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:53.951105 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:53.951304 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:53.951988 (+ 684us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:53.952013 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:53.954306 (+ 2293us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:53.957816 (+ 3510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:53.957826 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:53.957845 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:53.958353 (+ 508us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:53.958743 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:53.958746 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:53.958749 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:53.958955 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:53.959461 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:53.959467 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:53.959908 (+ 441us) client_negotiation.cc:769] Sending connection context
0619 06:38:53.960153 (+ 245us) client_negotiation.cc:240] Negotiation successful
0619 06:38:53.960576 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":360,"threads_started":1}
I20260619 06:38:53.963110 17617 heartbeater.cc:347] Connected to a master server at 127.10.192.126:33459
I20260619 06:38:53.963454 17617 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:53.964284 17617 heartbeater.cc:511] Master 127.10.192.126:33459 requested a full tablet report, sending...
I20260619 06:38:53.965854 17160 ts_manager.cc:194] Registered new tserver with Master: 40d10e23a819488ab3a62103a775c085 (127.10.192.67:35425)
I20260619 06:38:53.966796 17160 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:38433
I20260619 06:38:53.970449 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.10.192.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.192.125@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.192.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.125.keytab.
Entry for principal oryx/127.10.192.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.125.keytab.
I20260619 06:38:54.019532 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.125:37681
--webserver_interface=127.10.192.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.125.keytab
--principal=oryx/127.10.192.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:37949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:33459,127.10.192.125:37681
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:38:54.347199 17623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:54.347572 17623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:54.347775 17623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:54.355208 17623 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:38:54.355365 17623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:54.355471 17623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:54.355573 17623 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:38:54.355675 17623 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:38:54.365650 17623 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:37949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:33459,127.10.192.125:37681
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.125.keytab
--principal=oryx/127.10.192.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.125:37681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.192.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
W20260619 06:38:54.366058 17623 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.10.192.126:33459,127.10.192.125:37681'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260619 06:38:54.367244 17623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:54.368788 17623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:54.380856 17628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:54.380940 17629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:54.380909 17631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:54.382146 17623 server_base.cc:1034] running on GCE node
I20260619 06:38:54.383030 17623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:54.384532 17623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:54.385795 17623 hybrid_clock.cc:648] HybridClock initialized: now 1781851134385711 us; error 56 us; skew 500 ppm
I20260619 06:38:54.386144 17623 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:54 dist-test-slave-7lz4 krb5kdc[17115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851134, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:54.389299 17623 init.cc:377] Logged in from keytab as oryx/127.10.192.125@KRBTEST.COM (short username oryx)
I20260619 06:38:54.390825 17623 webserver.cc:460] Webserver started at http://127.10.192.125:44515/ using document root <none> and password file <none>
I20260619 06:38:54.391541 17623 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:54.391695 17623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:54.392020 17623 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:54.395015 17623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/data/instance:
uuid: "205072f35950483fbe0bcfdf30f66e62"
format_stamp: "Formatted at 2026-06-19 06:38:54 on dist-test-slave-7lz4"
server_key: "4300f31eeb8a5782c26ea0ef33a23215"
server_key_iv: "02238995fa487bc0951b8e48f62a8129"
server_key_version: "encryptionkey@0"
I20260619 06:38:54.395869 17623 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/wal/instance:
uuid: "205072f35950483fbe0bcfdf30f66e62"
format_stamp: "Formatted at 2026-06-19 06:38:54 on dist-test-slave-7lz4"
server_key: "4300f31eeb8a5782c26ea0ef33a23215"
server_key_iv: "02238995fa487bc0951b8e48f62a8129"
server_key_version: "encryptionkey@0"
I20260619 06:38:54.401257 17623 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260619 06:38:54.404697 17638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:54.406086 17623 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:38:54.406256 17623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/wal
uuid: "205072f35950483fbe0bcfdf30f66e62"
format_stamp: "Formatted at 2026-06-19 06:38:54 on dist-test-slave-7lz4"
server_key: "4300f31eeb8a5782c26ea0ef33a23215"
server_key_iv: "02238995fa487bc0951b8e48f62a8129"
server_key_version: "encryptionkey@0"
I20260619 06:38:54.406477 17623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:54.424906 17623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:54.429414 17623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:54.429719 17623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:54.449223 17623 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.125:37681
I20260619 06:38:54.449281 17689 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.125:37681 every 8 connection(s)
I20260619 06:38:54.449549 17483 heartbeater.cc:503] Master 127.10.192.126:33459 was elected leader, sending a full tablet report...
I20260619 06:38:54.450994 17623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/data/info.pb
I20260619 06:38:54.455102 17690 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:54.461313 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 17623
I20260619 06:38:54.461812 17690 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 06:38:54 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851134, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.125@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM
Jun 19 06:38:54 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.192.125@KRBTEST.COM
I20260619 06:38:54.482827 17694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:54.464679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52304 (local address 127.10.192.126:33459)
0619 06:38:54.465240 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:54.465246 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:54.465795 (+ 549us) server_negotiation.cc:407] Connection header received
0619 06:38:54.466984 (+ 1189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:54.466989 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:54.467051 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:54.467143 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:54.468594 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.469411 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.471222 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.471900 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.471991 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:54.475972 (+ 3981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:54.475978 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:54.475981 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:54.476017 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:54.479414 (+ 3397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:54.480244 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:54.480251 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:54.480255 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:54.480410 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:54.480860 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:54.480863 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:54.480866 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:54.481181 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:54.481342 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:54.482213 (+ 871us) server_negotiation.cc:299] Negotiation successful
0619 06:38:54.482448 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":258,"threads_started":1}
I20260619 06:38:54.484148 17693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:54.463549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58226 (local address 127.10.192.125:37681)
0619 06:38:54.464442 (+ 893us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:54.464453 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:54.464489 (+ 36us) server_negotiation.cc:407] Connection header received
0619 06:38:54.466718 (+ 2229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:54.466746 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:54.467050 (+ 304us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:54.467260 (+ 210us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:54.468855 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.470429 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.471872 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.472806 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.472946 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:54.477180 (+ 4234us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:54.477191 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:54.477207 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:54.477247 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:54.480664 (+ 3417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:54.481334 (+ 670us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:54.481343 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:54.481346 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:54.481497 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:54.481922 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:54.481926 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:54.481927 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:54.482361 (+ 434us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:54.482663 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:54.483013 (+ 350us) server_negotiation.cc:299] Negotiation successful
0619 06:38:54.483226 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":656,"thread_start_us":389,"threads_started":1}
I20260619 06:38:54.484194 17695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:54.464654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:52304)
0619 06:38:54.465584 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:54.465635 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:54.466718 (+ 1083us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:54.467228 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:54.467235 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:54.468056 (+ 821us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:54.468420 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:54.468437 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.469555 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.469562 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:54.471089 (+ 1527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:54.471099 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.472124 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.472131 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:54.472512 (+ 381us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:54.473318 (+ 806us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:54.473344 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:54.475781 (+ 2437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:54.479564 (+ 3783us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:54.479573 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:54.479588 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:54.480124 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:54.480525 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:54.480528 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:54.480530 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:54.480704 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:54.481326 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:54.481333 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:54.481758 (+ 425us) client_negotiation.cc:769] Sending connection context
0619 06:38:54.482084 (+ 326us) client_negotiation.cc:240] Negotiation successful
0619 06:38:54.482516 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"mutex_wait_us":66,"thread_start_us":516,"threads_started":1}
I20260619 06:38:54.486120 17690 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 06:38:54 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851134, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.125@KRBTEST.COM for oryx/127.10.192.125@KRBTEST.COM
I20260619 06:38:54.498987 17695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:54.487023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:37681 (local address 127.0.0.1:58238)
0619 06:38:54.487199 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:54.487219 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:54.487328 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:54.487613 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:54.487617 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:54.487997 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:54.488118 (+ 121us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:54.488126 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.489083 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.489089 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:54.489951 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:54.489962 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.490617 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.490622 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:54.490845 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:54.491370 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:54.491386 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:54.493798 (+ 2412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:54.496621 (+ 2823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:54.496629 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:54.496633 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:54.496984 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:54.497348 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:54.497352 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:54.497356 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:54.497498 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:54.497999 (+ 501us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:54.498004 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:54.498177 (+ 173us) client_negotiation.cc:769] Sending connection context
0619 06:38:54.498308 (+ 131us) client_negotiation.cc:240] Negotiation successful
0619 06:38:54.498618 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260619 06:38:54.499063 17693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:54.486865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58238 (local address 127.10.192.125:37681)
0619 06:38:54.487247 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:54.487255 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:54.487272 (+ 17us) server_negotiation.cc:407] Connection header received
0619 06:38:54.487438 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:54.487443 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:54.487507 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:54.487601 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:54.488245 (+ 644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.488944 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.490084 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.490474 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.490608 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:54.493979 (+ 3371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:54.493986 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:54.493991 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:54.494029 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:54.496491 (+ 2462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:54.497098 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:54.497105 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:54.497108 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:54.497236 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:54.497599 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:54.497607 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:54.497610 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:54.497879 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:54.498071 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:54.498402 (+ 331us) server_negotiation.cc:299] Negotiation successful
0619 06:38:54.498740 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":201,"server-negotiator.queue_time_us":284}
I20260619 06:38:54.504016 17690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: Bootstrap starting.
I20260619 06:38:54.507428 17690 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:54.508499 17690 log.cc:824] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:54.511304 17690 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: No bootstrap required, opened a new log
I20260619 06:38:54.518342 17690 raft_consensus.cc:348] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } }
I20260619 06:38:54.518671 17690 raft_consensus.cc:374] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:54.518744 17690 raft_consensus.cc:729] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 205072f35950483fbe0bcfdf30f66e62, State: Initialized, Role: FOLLOWER
I20260619 06:38:54.519327 17690 consensus_queue.cc:260] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } }
I20260619 06:38:54.520206 17697 sys_catalog.cc:455] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } } }
I20260619 06:38:54.520596 17697 sys_catalog.cc:458] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:38:54.521385 17690 sys_catalog.cc:564] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [sys.catalog]: configured and running, proceeding with master startup.
W20260619 06:38:54.530723 17708 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 06:38:54.530889 17708 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 06:38:54.533020 17623 master_runner.cc:428] Detected that this master 205072f35950483fbe0bcfdf30f66e62 is joining an existing cluster
I20260619 06:38:54.533140 17623 master_runner.cc:432] Initiating AddMaster RPC to add 127.10.192.125:37681
I20260619 06:38:54.554556 17694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:54.536996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52312 (local address 127.10.192.126:33459)
0619 06:38:54.537182 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:54.537189 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:54.538169 (+ 980us) server_negotiation.cc:407] Connection header received
0619 06:38:54.538423 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:54.538429 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:54.538529 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:54.538599 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:54.540198 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.541429 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.543607 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.544323 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.544434 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:54.547218 (+ 2784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:54.547227 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:54.547235 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:54.547284 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:54.550930 (+ 3646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:54.551816 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:54.551823 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:54.551827 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:54.551980 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:54.552441 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:54.552446 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:54.552450 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:54.552932 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:54.553116 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:54.553793 (+ 677us) server_negotiation.cc:299] Negotiation successful
0619 06:38:54.554125 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260619 06:38:54.555796 17714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:54.537095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:52312)
0619 06:38:54.538067 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:54.538087 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:54.538267 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:54.538829 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:54.538834 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:54.539559 (+ 725us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:54.540018 (+ 459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:54.540033 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.541612 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.541619 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:54.543437 (+ 1818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:54.543454 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.544731 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.544740 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:54.544984 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:54.545716 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:54.545744 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:54.547000 (+ 1256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:54.551086 (+ 4086us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:54.551092 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:54.551099 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:54.551674 (+ 575us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:54.552125 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:54.552130 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:54.552134 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:54.552312 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:54.553202 (+ 890us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:54.553206 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:54.553414 (+ 208us) client_negotiation.cc:769] Sending connection context
0619 06:38:54.554838 (+ 1424us) client_negotiation.cc:240] Negotiation successful
0619 06:38:54.555225 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":828,"thread_start_us":6548,"threads_started":1}
I20260619 06:38:54.564602 17693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:54.537667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58254 (local address 127.10.192.125:37681)
0619 06:38:54.537847 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:54.537856 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:54.548217 (+ 10361us) server_negotiation.cc:407] Connection header received
0619 06:38:54.548397 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:54.548402 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:54.548472 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:54.548544 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:54.549901 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.551011 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.552960 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.553676 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.553757 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:54.556845 (+ 3088us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:54.556852 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:54.556856 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:54.556887 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:54.561143 (+ 4256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:54.561946 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:54.561951 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:54.561954 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:54.562086 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:54.562505 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:54.562512 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:54.562518 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:54.562881 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:54.563063 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:54.563744 (+ 681us) server_negotiation.cc:299] Negotiation successful
0619 06:38:54.564045 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260619 06:38:54.566431 17715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:54.537242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:37681 (local address 127.0.0.1:58254)
0619 06:38:54.548110 (+ 10868us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:54.548126 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:54.548276 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:54.548717 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:54.548722 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:54.549420 (+ 698us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:54.549733 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:54.549745 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.551208 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.551213 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:54.552820 (+ 1607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:54.552833 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.554055 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.554062 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:54.554225 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:54.555237 (+ 1012us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:54.555265 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:54.556673 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:54.561322 (+ 4649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:54.561327 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:54.561332 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:54.561827 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:54.562209 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:54.562213 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:54.562217 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:54.562396 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:54.563162 (+ 766us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:54.563170 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:54.563411 (+ 241us) client_negotiation.cc:769] Sending connection context
0619 06:38:54.565355 (+ 1944us) client_negotiation.cc:240] Negotiation successful
0619 06:38:54.565733 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10748,"thread_start_us":10542,"threads_started":1}
WARNING: no policy specified for oryx/127.10.192.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.192.124@KRBTEST.COM" created.
Jun 19 06:38:54 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851132, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.126@KRBTEST.COM for oryx/127.10.192.125@KRBTEST.COM
I20260619 06:38:54.587069 17693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:54.563230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58260 (local address 127.10.192.125:37681)
0619 06:38:54.565297 (+ 2067us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:54.565319 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:54.571614 (+ 6295us) server_negotiation.cc:407] Connection header received
0619 06:38:54.572019 (+ 405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:54.572027 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:54.572159 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:54.572282 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:54.573971 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.575019 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.576870 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.577333 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.577475 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:54.580927 (+ 3452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:54.580933 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:54.580936 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:54.580967 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:54.584255 (+ 3288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:54.585004 (+ 749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:54.585010 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:54.585014 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:54.585150 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:54.585540 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:54.585545 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:54.585547 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:54.585794 (+ 247us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:54.585960 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:54.586431 (+ 471us) server_negotiation.cc:299] Negotiation successful
0619 06:38:54.586659 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1926,"thread_start_us":8924,"threads_started":1}
I20260619 06:38:54.587105 17717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:54.562726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:37681 (local address 127.0.0.1:58260)
0619 06:38:54.571481 (+ 8755us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:54.571529 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:54.571783 (+ 254us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:54.572384 (+ 601us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:54.572393 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:54.573403 (+ 1010us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:54.573763 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:54.573777 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.575606 (+ 1829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.575611 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:54.576707 (+ 1096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:54.576723 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.577499 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.577505 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:54.577703 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:54.578390 (+ 687us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:54.578407 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:54.580716 (+ 2309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:54.584408 (+ 3692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:54.584422 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:54.584430 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:54.584871 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:54.585263 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:54.585268 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:54.585272 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:54.585419 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:54.585935 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:54.585944 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:54.586130 (+ 186us) client_negotiation.cc:769] Sending connection context
0619 06:38:54.586311 (+ 181us) client_negotiation.cc:240] Negotiation successful
0619 06:38:54.586659 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8498,"thread_start_us":8338,"threads_started":1}
I20260619 06:38:54.589524 17160 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.10.192.125:37681: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "205072f35950483fbe0bcfdf30f66e62"
member_type: NON_VOTER
last_known_addr {
host: "127.10.192.125"
port: 37681
}
attrs {
promote: true
}
}
dest_uuid: "54987b0b55b74c9585053e4148f4635a"
cas_config_opid_index: -1
I20260619 06:38:54.590490 17160 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: NON_VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: true } }
I20260619 06:38:54.599296 17721 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 205072f35950483fbe0bcfdf30f66e62 (127.10.192.125) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: NON_VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: true } } }
I20260619 06:38:54.600622 17665 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:54.604727 17665 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 1 FOLLOWER]: Refusing update from remote peer 54987b0b55b74c9585053e4148f4635a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.192.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.124.keytab.
Entry for principal oryx/127.10.192.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.124.keytab.
I20260619 06:38:54.605774 17721 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.10.192.125:37681
I20260619 06:38:54.606542 17623 master.cc:537] Master@127.10.192.125:37681 shutting down...
I20260619 06:38:54.607465 17722 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "54987b0b55b74c9585053e4148f4635a" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: NON_VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: true } } }
I20260619 06:38:54.607817 17722 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:54.607949 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.124:35867
--webserver_interface=127.10.192.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.124.keytab
--principal=oryx/127.10.192.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:37949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:33459,127.10.192.125:37681,127.10.192.124:35867
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:38:54.609063 17721 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [LEADER]: Connected to new peer: Peer: permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: NON_VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 06:38:54.621241 17146 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260619 06:38:54.624048 17146 consensus_peers.cc:487] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a -> Peer 205072f35950483fbe0bcfdf30f66e62 (127.10.192.125:37681): Couldn't send request to peer 205072f35950483fbe0bcfdf30f66e62. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260619 06:38:54.625653 17623 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:54.626155 17623 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:54.626379 17623 tablet_replica.cc:330] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: stopping tablet replica
I20260619 06:38:54.633863 17623 master.cc:552] Master@127.10.192.125:37681 shutdown complete.
I20260619 06:38:54.633960 17623 master_runner.cc:305] Clearing existing system tablet
I20260619 06:38:54.634394 17623 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:54.634491 17623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:54.637501 17623 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.004s sys 0.000s
I20260619 06:38:54.639266 17728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:54.639653 17623 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:54.639920 17623 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260619 06:38:54.639999 17623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/wal
uuid: "205072f35950483fbe0bcfdf30f66e62"
format_stamp: "Formatted at 2026-06-19 06:38:54 on dist-test-slave-7lz4"
server_key: "4300f31eeb8a5782c26ea0ef33a23215"
server_key_iv: "02238995fa487bc0951b8e48f62a8129"
server_key_version: "encryptionkey@0"
I20260619 06:38:54.645002 17623 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:54.652071 17623 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260619 06:38:54.652261 17623 log.cc:1196] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260619 06:38:54.652716 17623 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: Deleting consensus metadata
I20260619 06:38:54.652976 17623 master_runner.cc:315] Copying system tablet from 127.10.192.126:33459
I20260619 06:38:54.655617 17623 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: tablet copy: Beginning tablet copy session from remote peer at address 127.10.192.126:33459
I20260619 06:38:54.674876 17694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:54.656517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52316 (local address 127.10.192.126:33459)
0619 06:38:54.656759 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:54.656767 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:54.660224 (+ 3457us) server_negotiation.cc:407] Connection header received
0619 06:38:54.660442 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:54.660448 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:54.660536 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:54.660654 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:54.661700 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.662819 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.664729 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.665406 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.665538 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:54.668016 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:54.668026 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:54.668033 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:54.668078 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:54.671792 (+ 3714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:54.672660 (+ 868us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:54.672668 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:54.672674 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:54.672850 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:54.673277 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:54.673281 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:54.673284 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:54.673673 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:54.673829 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:54.674279 (+ 450us) server_negotiation.cc:299] Negotiation successful
0619 06:38:54.674516 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260619 06:38:54.674960 17734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:54.656423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:52316)
0619 06:38:54.660070 (+ 3647us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:54.660090 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:54.660273 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:54.660696 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:54.660702 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:54.661239 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:54.661523 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:54.661536 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.662978 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.662984 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:54.664544 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:54.664560 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:54.665574 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:54.665581 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:54.665771 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:54.666515 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:54.666539 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:54.667780 (+ 1241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:54.671943 (+ 4163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:54.671950 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:54.671954 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:54.672487 (+ 533us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:54.672972 (+ 485us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:54.672977 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:54.672981 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:54.673143 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:54.673802 (+ 659us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:54.673806 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:54.673987 (+ 181us) client_negotiation.cc:769] Sending connection context
0619 06:38:54.674138 (+ 151us) client_negotiation.cc:240] Negotiation successful
0619 06:38:54.674470 (+ 332us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3480,"thread_start_us":3372,"threads_started":1}
I20260619 06:38:54.676182 17180 tablet_copy_service.cc:140] P 54987b0b55b74c9585053e4148f4635a: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 205072f35950483fbe0bcfdf30f66e62 ({username='oryx', principal='oryx/127.10.192.125@KRBTEST.COM'} at 127.0.0.1:52316)
I20260619 06:38:54.676483 17180 tablet_copy_service.cc:161] P 54987b0b55b74c9585053e4148f4635a: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 205072f35950483fbe0bcfdf30f66e62 at {username='oryx', principal='oryx/127.10.192.125@KRBTEST.COM'} at 127.0.0.1:52316: session id = 205072f35950483fbe0bcfdf30f66e62-00000000000000000000000000000000
I20260619 06:38:54.681981 17180 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a: Tablet Copy: opened 0 blocks and 1 log segments
I20260619 06:38:54.684546 17623 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260619 06:38:54.691582 17623 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: tablet copy: Starting download of 0 data blocks...
I20260619 06:38:54.691952 17623 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: tablet copy: Starting download of 1 WAL segments...
I20260619 06:38:54.694816 17623 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260619 06:38:54.699497 17180 tablet_copy_service.cc:342] P 54987b0b55b74c9585053e4148f4635a: Request end of tablet copy session 205072f35950483fbe0bcfdf30f66e62-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.10.192.125@KRBTEST.COM'} at 127.0.0.1:52316
I20260619 06:38:54.699774 17180 tablet_copy_service.cc:433] P 54987b0b55b74c9585053e4148f4635a: ending tablet copy session 205072f35950483fbe0bcfdf30f66e62-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 205072f35950483fbe0bcfdf30f66e62
I20260619 06:38:54.719151 17623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:54.721915 17735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:54.725122 17736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:54.735703 17738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:54.735972 17623 server_base.cc:1034] running on GCE node
I20260619 06:38:54.736536 17623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:54.737251 17623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:54.738492 17623 hybrid_clock.cc:648] HybridClock initialized: now 1781851134738432 us; error 41 us; skew 500 ppm
I20260619 06:38:54.738713 17623 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:54 dist-test-slave-7lz4 krb5kdc[17115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851134, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:54.740907 17623 init.cc:377] Logged in from keytab as oryx/127.10.192.125@KRBTEST.COM (short username oryx)
I20260619 06:38:54.742153 17623 webserver.cc:460] Webserver started at http://127.10.192.125:43301/ using document root <none> and password file <none>
I20260619 06:38:54.742707 17623 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:54.742785 17623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:54.746093 17623 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.002s sys 0.000s
I20260619 06:38:54.747977 17745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:54.748410 17623 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s
I20260619 06:38:54.748549 17623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/wal
uuid: "205072f35950483fbe0bcfdf30f66e62"
format_stamp: "Formatted at 2026-06-19 06:38:54 on dist-test-slave-7lz4"
server_key: "4300f31eeb8a5782c26ea0ef33a23215"
server_key_iv: "02238995fa487bc0951b8e48f62a8129"
server_key_version: "encryptionkey@0"
I20260619 06:38:54.748710 17623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:54.774626 17623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:54.778857 17623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:54.808305 17623 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.125:37681
I20260619 06:38:54.808372 17796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.125:37681 every 8 connection(s)
I20260619 06:38:54.809315 17623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-1/data/info.pb
I20260619 06:38:54.815131 17797 sys_catalog.cc:263] Verifying existing consensus state
I20260619 06:38:54.820077 17797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: Bootstrap starting.
I20260619 06:38:54.840099 17797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 06:38:54.840869 17797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: Bootstrap complete.
I20260619 06:38:54.842090 17797 raft_consensus.cc:348] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: NON_VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: true } }
I20260619 06:38:54.842473 17797 raft_consensus.cc:729] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 205072f35950483fbe0bcfdf30f66e62, State: Initialized, Role: LEARNER
I20260619 06:38:54.842746 17797 consensus_queue.cc:260] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: NON_VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: true } }
I20260619 06:38:54.843745 17800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: NON_VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: true } } }
I20260619 06:38:54.844012 17800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [sys.catalog]: This master's current role is: LEARNER
I20260619 06:38:54.844185 17797 sys_catalog.cc:564] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:38:54.852357 17811 catalog_manager.cc:1259] Loaded cluster ID: e0d8d3da0d5e4194a70beb96d7c6ec54
I20260619 06:38:54.852489 17811 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: loading cluster ID for follower catalog manager: success
I20260619 06:38:54.856058 17811 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: acquiring CA information for follower catalog manager: success
I20260619 06:38:54.858448 17811 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 06:38:54.970093 17617 heartbeater.cc:503] Master 127.10.192.126:33459 was elected leader, sending a full tablet report...
W20260619 06:38:55.008544 17726 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:55.008888 17726 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:55.009040 17726 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:55.016603 17726 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:38:55.016757 17726 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:55.016880 17726 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:55.016981 17726 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:38:55.017062 17726 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:38:55.027617 17726 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:37949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:33459,127.10.192.125:37681,127.10.192.124:35867
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.124.keytab
--principal=oryx/127.10.192.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.124:35867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.192.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:55.029376 17726 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:55.031147 17726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:55.043208 17816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:55.043274 17817 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:55.043251 17819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:55.044281 17726 server_base.cc:1034] running on GCE node
I20260619 06:38:55.045156 17726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:55.046700 17726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:55.047947 17726 hybrid_clock.cc:648] HybridClock initialized: now 1781851135047873 us; error 85 us; skew 500 ppm
I20260619 06:38:55.048384 17726 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:55 dist-test-slave-7lz4 krb5kdc[17115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851135, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:55.051841 17726 init.cc:377] Logged in from keytab as oryx/127.10.192.124@KRBTEST.COM (short username oryx)
I20260619 06:38:55.053450 17726 webserver.cc:460] Webserver started at http://127.10.192.124:44719/ using document root <none> and password file <none>
I20260619 06:38:55.054160 17726 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:55.054330 17726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:55.054634 17726 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:38:55.057623 17726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/data/instance:
uuid: "9dbd17a454d34e55af9770b0e4565cf5"
format_stamp: "Formatted at 2026-06-19 06:38:55 on dist-test-slave-7lz4"
server_key: "123f5b254ebe5d54ef7a27f8a0a591d2"
server_key_iv: "79928c0196256155bc45ead8b06859cc"
server_key_version: "encryptionkey@0"
I20260619 06:38:55.058442 17726 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/wal/instance:
uuid: "9dbd17a454d34e55af9770b0e4565cf5"
format_stamp: "Formatted at 2026-06-19 06:38:55 on dist-test-slave-7lz4"
server_key: "123f5b254ebe5d54ef7a27f8a0a591d2"
server_key_iv: "79928c0196256155bc45ead8b06859cc"
server_key_version: "encryptionkey@0"
I20260619 06:38:55.063674 17726 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 06:38:55.067173 17826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:55.068766 17726 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:38:55.068957 17726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/wal
uuid: "9dbd17a454d34e55af9770b0e4565cf5"
format_stamp: "Formatted at 2026-06-19 06:38:55 on dist-test-slave-7lz4"
server_key: "123f5b254ebe5d54ef7a27f8a0a591d2"
server_key_iv: "79928c0196256155bc45ead8b06859cc"
server_key_version: "encryptionkey@0"
I20260619 06:38:55.069162 17726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:55.081694 17726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:55.085853 17726 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:55.086162 17726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:55.105875 17726 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.124:35867
I20260619 06:38:55.105878 17877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.124:35867 every 8 connection(s)
I20260619 06:38:55.107313 17726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/data/info.pb
I20260619 06:38:55.109694 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 17726
I20260619 06:38:55.111339 17878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:55.119398 17878 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 06:38:55 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.192.124@KRBTEST.COM
Jun 19 06:38:55 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851135, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.124@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM
I20260619 06:38:55.134464 17881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.111867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55606 (local address 127.10.192.124:35867)
0619 06:38:55.112868 (+ 1001us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:55.112881 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:55.112923 (+ 42us) server_negotiation.cc:407] Connection header received
0619 06:38:55.114463 (+ 1540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:55.114485 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:55.114899 (+ 414us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:55.115320 (+ 421us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:55.116839 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.118294 (+ 1455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.119573 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.120370 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.120612 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.125847 (+ 5235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:55.125855 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:55.125865 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:55.125899 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:55.129686 (+ 3787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.130361 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.130375 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.130384 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.130626 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.131043 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.131046 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.131048 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.131725 (+ 677us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:55.131958 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:55.132523 (+ 565us) server_negotiation.cc:299] Negotiation successful
0619 06:38:55.132948 (+ 425us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":759,"thread_start_us":495,"threads_started":1}
I20260619 06:38:55.138301 17694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.122271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52328 (local address 127.10.192.126:33459)
0619 06:38:55.122495 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:55.122503 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:55.123025 (+ 522us) server_negotiation.cc:407] Connection header received
0619 06:38:55.123206 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:55.123212 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:55.123311 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:55.123438 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:55.124865 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.125921 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.128133 (+ 2212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.128516 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.128614 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.132374 (+ 3760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:55.132381 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:55.132385 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:55.132425 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:55.135538 (+ 3113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.136382 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.136387 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.136390 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.136553 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.136921 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.136926 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.136929 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.137273 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:55.137413 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:55.137910 (+ 497us) server_negotiation.cc:299] Negotiation successful
0619 06:38:55.138086 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 06:38:55.138314 17882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.122077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:52328)
0619 06:38:55.122885 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:55.122932 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:55.123077 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:55.123682 (+ 605us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:55.123691 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:55.124416 (+ 725us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:55.124680 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.124690 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.126084 (+ 1394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.126093 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.127983 (+ 1890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.128003 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.128708 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.128714 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.128888 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.129544 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:55.129568 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:55.132181 (+ 2613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:55.135717 (+ 3536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:55.135725 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:55.135732 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:55.136226 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:55.136657 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:55.136660 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:55.136662 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:55.136789 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:55.137422 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:55.137431 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:55.137621 (+ 190us) client_negotiation.cc:769] Sending connection context
0619 06:38:55.137796 (+ 175us) client_negotiation.cc:240] Negotiation successful
0619 06:38:55.138041 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":402,"threads_started":1}
I20260619 06:38:55.139515 17878 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 06:38:55 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851135, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.124@KRBTEST.COM for oryx/127.10.192.125@KRBTEST.COM
I20260619 06:38:55.152421 17883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.140391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58268 (local address 127.10.192.125:37681)
0619 06:38:55.140880 (+ 489us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:55.140885 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:55.140900 (+ 15us) server_negotiation.cc:407] Connection header received
0619 06:38:55.140957 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:55.140960 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:55.141017 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:55.141101 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:55.141711 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.142697 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.143929 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.144342 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.144436 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.147323 (+ 2887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:55.147328 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:55.147331 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:55.147363 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:55.149847 (+ 2484us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.150565 (+ 718us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.150568 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.150571 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.150704 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.151168 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.151171 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.151173 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.151416 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:55.151533 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:55.152010 (+ 477us) server_negotiation.cc:299] Negotiation successful
0619 06:38:55.152171 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":382,"thread_start_us":269,"threads_started":1}
I20260619 06:38:55.152510 17882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.140330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:37681 (local address 127.0.0.1:58268)
0619 06:38:55.140529 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:55.140551 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:55.140675 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:55.141135 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:55.141138 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:55.141463 (+ 325us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:55.141592 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.141599 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.142798 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.142802 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.143803 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.143816 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.144471 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.144476 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.144590 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.145115 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:55.145131 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:55.147118 (+ 1987us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:55.150022 (+ 2904us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:55.150025 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:55.150028 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:55.150464 (+ 436us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:55.150846 (+ 382us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:55.150850 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:55.150853 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:55.151015 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:55.151538 (+ 523us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:55.151541 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:55.151785 (+ 244us) client_negotiation.cc:769] Sending connection context
0619 06:38:55.151932 (+ 147us) client_negotiation.cc:240] Negotiation successful
0619 06:38:55.152179 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260619 06:38:55.153856 17878 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 06:38:55 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851135, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.124@KRBTEST.COM for oryx/127.10.192.124@KRBTEST.COM
I20260619 06:38:55.166071 17881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.154700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55616 (local address 127.10.192.124:35867)
0619 06:38:55.154846 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:55.154853 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:55.154938 (+ 85us) server_negotiation.cc:407] Connection header received
0619 06:38:55.155111 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:55.155115 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:55.155177 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:55.155270 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:55.155958 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.156648 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.157727 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.158147 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.158281 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.161225 (+ 2944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:55.161229 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:55.161232 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:55.161257 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:55.163551 (+ 2294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.164170 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.164178 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.164182 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.164302 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.164664 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.164672 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.164675 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.164920 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:55.165068 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:55.165386 (+ 318us) server_negotiation.cc:299] Negotiation successful
0619 06:38:55.165738 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":133,"server-negotiator.queue_time_us":46}
I20260619 06:38:55.166044 17882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.154655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:35867 (local address 127.0.0.1:55616)
0619 06:38:55.154846 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:55.154865 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:55.155003 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:55.155282 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:55.155287 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:55.155696 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:55.155835 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.155843 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.156767 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.156775 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.157597 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.157606 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.158296 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.158301 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.158481 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.159054 (+ 573us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:55.159069 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:55.161041 (+ 1972us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:55.163705 (+ 2664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:55.163712 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:55.163715 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:55.164055 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:55.164414 (+ 359us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:55.164420 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:55.164424 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:55.164564 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:55.165031 (+ 467us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:55.165035 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:55.165185 (+ 150us) client_negotiation.cc:769] Sending connection context
0619 06:38:55.165320 (+ 135us) client_negotiation.cc:240] Negotiation successful
0619 06:38:55.165588 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55}
I20260619 06:38:55.171164 17878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: Bootstrap starting.
I20260619 06:38:55.174422 17878 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:55.175443 17878 log.cc:824] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:55.178083 17878 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: No bootstrap required, opened a new log
I20260619 06:38:55.185262 17878 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } }
I20260619 06:38:55.185606 17878 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:55.185747 17878 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9dbd17a454d34e55af9770b0e4565cf5, State: Initialized, Role: FOLLOWER
I20260619 06:38:55.186321 17878 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } }
I20260619 06:38:55.187140 17885 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } } }
I20260619 06:38:55.187433 17885 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:38:55.188277 17878 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [sys.catalog]: configured and running, proceeding with master startup.
W20260619 06:38:55.197692 17896 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 06:38:55.197854 17896 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 06:38:55.201401 17726 master_runner.cc:428] Detected that this master 9dbd17a454d34e55af9770b0e4565cf5 is joining an existing cluster
I20260619 06:38:55.201557 17726 master_runner.cc:432] Initiating AddMaster RPC to add 127.10.192.124:35867
I20260619 06:38:55.230816 17694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.211141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52332 (local address 127.10.192.126:33459)
0619 06:38:55.211412 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:55.211421 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:55.212274 (+ 853us) server_negotiation.cc:407] Connection header received
0619 06:38:55.212554 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:55.212562 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:55.212651 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:55.212728 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:55.214688 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.216236 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.219794 (+ 3558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.220475 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.220573 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.223474 (+ 2901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:55.223482 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:55.223488 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:55.223534 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:55.227041 (+ 3507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.228294 (+ 1253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.228302 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.228305 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.228453 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.228980 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.228986 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.228990 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.229374 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:55.229508 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:55.230109 (+ 601us) server_negotiation.cc:299] Negotiation successful
0619 06:38:55.230379 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260619 06:38:55.231968 17902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.210685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:52332)
0619 06:38:55.212160 (+ 1475us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:55.212182 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:55.212387 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:55.213003 (+ 616us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:55.213007 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:55.213944 (+ 937us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:55.214444 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.214461 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.216481 (+ 2020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.216489 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.218813 (+ 2324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.218833 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.221176 (+ 2343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.221185 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.221396 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.222152 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:55.222175 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:55.223249 (+ 1074us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:55.227196 (+ 3947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:55.227200 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:55.227204 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:55.228133 (+ 929us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:55.228619 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:55.228624 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:55.228627 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:55.228831 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:55.229579 (+ 748us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:55.229583 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:55.229808 (+ 225us) client_negotiation.cc:769] Sending connection context
0619 06:38:55.231024 (+ 1216us) client_negotiation.cc:240] Negotiation successful
0619 06:38:55.231417 (+ 393us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1342,"thread_start_us":1182,"threads_started":1}
I20260619 06:38:55.237766 17881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.212651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55630 (local address 127.10.192.124:35867)
0619 06:38:55.212823 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:55.212829 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:55.219924 (+ 7095us) server_negotiation.cc:407] Connection header received
0619 06:38:55.220147 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:55.220152 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:55.220214 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:55.220274 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:55.222208 (+ 1934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.223325 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.225910 (+ 2585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.226609 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.226701 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.229677 (+ 2976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:55.229683 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:55.229687 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:55.229719 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:55.234482 (+ 4763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.235429 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.235435 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.235438 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.235606 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.236054 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.236059 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.236062 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.236450 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:55.236603 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:55.237133 (+ 530us) server_negotiation.cc:299] Negotiation successful
0619 06:38:55.237377 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260619 06:38:55.239465 17904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.212375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:35867 (local address 127.0.0.1:55630)
0619 06:38:55.219828 (+ 7453us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:55.219847 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:55.220030 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:55.220456 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:55.220460 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:55.221599 (+ 1139us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:55.222039 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.222057 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.223539 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.223543 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.225715 (+ 2172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.225729 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.226991 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.226998 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.227158 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.228091 (+ 933us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:55.228179 (+ 88us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:55.229501 (+ 1322us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:55.234642 (+ 5141us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:55.234647 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:55.234650 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:55.235300 (+ 650us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:55.235769 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:55.235774 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:55.235778 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:55.235922 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:55.236667 (+ 745us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:55.236672 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:55.236848 (+ 176us) client_negotiation.cc:769] Sending connection context
0619 06:38:55.238275 (+ 1427us) client_negotiation.cc:240] Negotiation successful
0619 06:38:55.238585 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7328,"mutex_wait_us":219,"spinlock_wait_cycles":27392,"thread_start_us":7168,"threads_started":1}
I20260619 06:38:55.239560 17883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.210724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58274 (local address 127.10.192.125:37681)
0619 06:38:55.210945 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:55.210952 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:55.219715 (+ 8763us) server_negotiation.cc:407] Connection header received
0619 06:38:55.219984 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:55.219990 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:55.220090 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:55.220159 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:55.222262 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.223339 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.226063 (+ 2724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.226748 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.226869 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.229626 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:55.229633 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:55.229637 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:55.229677 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:55.234396 (+ 4719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.235463 (+ 1067us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.235470 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.235473 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.235674 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.236168 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.236172 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.236175 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.238070 (+ 1895us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:55.238204 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:55.238830 (+ 626us) server_negotiation.cc:299] Negotiation successful
0619 06:38:55.239097 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260619 06:38:55.240672 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 17221
I20260619 06:38:55.240895 17903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.210729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:37681 (local address 127.0.0.1:58274)
0619 06:38:55.219578 (+ 8849us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:55.219611 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:55.219838 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:55.220355 (+ 517us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:55.220360 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:55.221582 (+ 1222us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:55.222069 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.222084 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.223534 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.223539 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.225898 (+ 2359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.225912 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.227153 (+ 1241us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.227160 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.227446 (+ 286us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.228118 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:55.228138 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:55.229439 (+ 1301us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:55.234741 (+ 5302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:55.234746 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:55.234749 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:55.235315 (+ 566us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:55.235834 (+ 519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:55.235839 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:55.235842 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:55.236016 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:55.238286 (+ 2270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:55.238291 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:55.238502 (+ 211us) client_negotiation.cc:769] Sending connection context
0619 06:38:55.239868 (+ 1366us) client_negotiation.cc:240] Negotiation successful
0619 06:38:55.240330 (+ 462us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8630,"mutex_wait_us":137,"thread_start_us":8379,"threads_started":1}
Jun 19 06:38:55 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.192.65@KRBTEST.COM
Jun 19 06:38:55 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851132, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.126@KRBTEST.COM for oryx/127.10.192.124@KRBTEST.COM
I20260619 06:38:55.265110 17906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.242437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33498 (local address 127.10.192.65:42847)
0619 06:38:55.243168 (+ 731us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:55.243178 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:55.243207 (+ 29us) server_negotiation.cc:407] Connection header received
0619 06:38:55.243275 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:55.243284 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:55.243566 (+ 282us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:55.243826 (+ 260us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:55.245927 (+ 2101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.248006 (+ 2079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.249999 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.250922 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.255321 (+ 4399us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.257144 (+ 1823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:55.257159 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:55.257180 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:55.257224 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:55.261026 (+ 3802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.261902 (+ 876us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.261912 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.261916 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.262061 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.262513 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.262518 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.262522 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.262931 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:55.264237 (+ 1306us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:55.264399 (+ 162us) server_negotiation.cc:299] Negotiation successful
0619 06:38:55.264666 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":676,"threads_started":1}
I20260619 06:38:55.266523 17344 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:55.269447 17881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.239264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55642 (local address 127.10.192.124:35867)
0619 06:38:55.239427 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:55.239433 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:55.252245 (+ 12812us) server_negotiation.cc:407] Connection header received
0619 06:38:55.252601 (+ 356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:55.252608 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:55.252721 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:55.252849 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:55.254074 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.255209 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.257145 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.257839 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.257946 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.262119 (+ 4173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:55.262126 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:55.262132 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:55.262172 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:55.265967 (+ 3795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.266996 (+ 1029us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.267002 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.267006 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.267154 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.267668 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.267673 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.267677 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.268168 (+ 491us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:55.268296 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:55.268844 (+ 548us) server_negotiation.cc:299] Negotiation successful
0619 06:38:55.269081 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260619 06:38:55.270447 17905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.238940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:35867 (local address 127.0.0.1:55642)
0619 06:38:55.252121 (+ 13181us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:55.252149 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:55.252378 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:55.252883 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:55.252889 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:55.253423 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:55.253744 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.253841 (+ 97us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.255409 (+ 1568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.255416 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.256973 (+ 1557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.256988 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.258226 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.258232 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.258419 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.259085 (+ 666us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:55.259109 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:55.261902 (+ 2793us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:55.266158 (+ 4256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:55.266163 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:55.266167 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:55.266852 (+ 685us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:55.267300 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:55.267305 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:55.267308 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:55.267501 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:55.268376 (+ 875us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:55.268382 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:55.268569 (+ 187us) client_negotiation.cc:769] Sending connection context
0619 06:38:55.269714 (+ 1145us) client_negotiation.cc:240] Negotiation successful
0619 06:38:55.270005 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13028,"thread_start_us":12872,"threads_started":1}
I20260619 06:38:55.271966 17160 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.10.192.124:35867: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5"
member_type: NON_VOTER
last_known_addr {
host: "127.10.192.124"
port: 35867
}
attrs {
promote: true
}
}
dest_uuid: "54987b0b55b74c9585053e4148f4635a"
cas_config_opid_index: 5
I20260619 06:38:55.272718 17160 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: NON_VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: true } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: NON_VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: true } }
I20260619 06:38:55.278309 17853 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:55.280081 17907 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 9dbd17a454d34e55af9770b0e4565cf5 (127.10.192.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: NON_VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: true } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: NON_VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: true } } }
I20260619 06:38:55.286537 17853 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 1 FOLLOWER]: Refusing update from remote peer 54987b0b55b74c9585053e4148f4635a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260619 06:38:55.296770 17907 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.10.192.124:35867
I20260619 06:38:55.296785 17883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.264264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58290 (local address 127.10.192.125:37681)
0619 06:38:55.264457 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:55.264462 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:55.274827 (+ 10365us) server_negotiation.cc:407] Connection header received
0619 06:38:55.275964 (+ 1137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:55.275970 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:55.276099 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:55.276211 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:55.287679 (+ 11468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.289187 (+ 1508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.292939 (+ 3752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.294851 (+ 1912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.295056 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.295336 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:55.296182 (+ 846us) server_negotiation.cc:299] Negotiation successful
0619 06:38:55.296398 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260619 06:38:55.297515 17726 master.cc:537] Master@127.10.192.124:35867 shutting down...
I20260619 06:38:55.297712 17908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.264616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:37681 (local address 127.0.0.1:58290)
0619 06:38:55.274681 (+ 10065us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:55.274707 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:55.275725 (+ 1018us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:55.276514 (+ 789us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:55.276522 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:55.276560 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:55.277034 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.277049 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.289524 (+ 12475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.289533 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.292660 (+ 3127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.292684 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.295610 (+ 2926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.295620 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.295894 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.295985 (+ 91us) client_negotiation.cc:769] Sending connection context
0619 06:38:55.297131 (+ 1146us) client_negotiation.cc:240] Negotiation successful
0619 06:38:55.297361 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9883,"thread_start_us":10247,"threads_started":1}
I20260619 06:38:55.299062 17772 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260619 06:38:55.299937 17800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54987b0b55b74c9585053e4148f4635a. Latest consensus state: current_term: 1 leader_uuid: "54987b0b55b74c9585053e4148f4635a" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: NON_VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: true } } }
I20260619 06:38:55.300218 17800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [sys.catalog]: This master's current role is: LEARNER
I20260619 06:38:55.300983 17772 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 1 LEARNER]: Refusing update from remote peer 54987b0b55b74c9585053e4148f4635a: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260619 06:38:55.305852 17907 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "54987b0b55b74c9585053e4148f4635a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: NON_VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: true } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: NON_VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: true } } }
I20260619 06:38:55.306479 17907 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:55.305074 17910 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: NON_VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.002s
I20260619 06:38:55.308990 17911 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [LEADER]: Connected to new peer: Peer: permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: NON_VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260619 06:38:55.318498 17772 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 9dbd17a454d34e55af9770b0e4565cf5 (127.10.192.124) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: NON_VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: true } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: NON_VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: true } } }
I20260619 06:38:55.322206 17800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "54987b0b55b74c9585053e4148f4635a" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: NON_VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: true } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: NON_VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: true } } }
I20260619 06:38:55.322502 17800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [sys.catalog]: This master's current role is: LEARNER
I20260619 06:38:55.323297 17911 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a: attempting to promote NON_VOTER 205072f35950483fbe0bcfdf30f66e62 to VOTER
I20260619 06:38:55.324080 17911 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: NON_VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: true } }
I20260619 06:38:55.326109 17772 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 1 LEARNER]: Refusing update from remote peer 54987b0b55b74c9585053e4148f4635a: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260619 06:38:55.326678 17912 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [LEADER]: Connected to new peer: Peer: permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260619 06:38:55.329237 17907 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 205072f35950483fbe0bcfdf30f66e62 (127.10.192.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: NON_VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: true } } }
I20260619 06:38:55.331979 17907 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "54987b0b55b74c9585053e4148f4635a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: NON_VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: true } } }
I20260619 06:38:55.332346 17907 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:55.332593 17907 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "54987b0b55b74c9585053e4148f4635a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: NON_VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: true } } }
I20260619 06:38:55.332818 17907 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:55.334251 17726 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:55.333745 17772 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 205072f35950483fbe0bcfdf30f66e62 (127.10.192.125) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: NON_VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: true } } }
I20260619 06:38:55.334676 17726 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:55.334894 17726 tablet_replica.cc:330] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: stopping tablet replica
I20260619 06:38:55.337924 17800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "54987b0b55b74c9585053e4148f4635a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: NON_VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: true } } }
I20260619 06:38:55.338227 17800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:38:55.341851 17726 master.cc:552] Master@127.10.192.124:35867 shutdown complete.
I20260619 06:38:55.341956 17726 master_runner.cc:305] Clearing existing system tablet
I20260619 06:38:55.342283 17726 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:55.342415 17726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:55.344857 17726 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.003s
I20260619 06:38:55.346477 17917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:55.346787 17726 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:55.347093 17726 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 06:38:55.347198 17726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/wal
uuid: "9dbd17a454d34e55af9770b0e4565cf5"
format_stamp: "Formatted at 2026-06-19 06:38:55 on dist-test-slave-7lz4"
server_key: "123f5b254ebe5d54ef7a27f8a0a591d2"
server_key_iv: "79928c0196256155bc45ead8b06859cc"
server_key_version: "encryptionkey@0"
I20260619 06:38:55.350222 17908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.349731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:35867 (local address 127.0.0.1:55658)
0619 06:38:55.349910 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:55.350050 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:35867: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260619 06:38:55.351315 17726 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260619 06:38:55.355824 17144 consensus_peers.cc:487] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a -> Peer 9dbd17a454d34e55af9770b0e4565cf5 (127.10.192.124:35867): Couldn't send request to peer 9dbd17a454d34e55af9770b0e4565cf5. Status: Network error: Client connection negotiation failed: client connection to 127.10.192.124:35867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260619 06:38:55.356457 17726 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260619 06:38:55.356630 17726 log.cc:1196] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260619 06:38:55.357074 17726 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: Deleting consensus metadata
I20260619 06:38:55.357311 17726 master_runner.cc:315] Copying system tablet from 127.10.192.126:33459
I20260619 06:38:55.359761 17726 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: tablet copy: Beginning tablet copy session from remote peer at address 127.10.192.126:33459
I20260619 06:38:55.375353 17694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.360529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52338 (local address 127.10.192.126:33459)
0619 06:38:55.360791 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:55.360800 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:55.364229 (+ 3429us) server_negotiation.cc:407] Connection header received
0619 06:38:55.364442 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:55.364448 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:55.364528 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:55.364639 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:55.365475 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.366261 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.367618 (+ 1357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.368081 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.368222 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.370053 (+ 1831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:55.370060 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:55.370064 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:55.370106 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:55.372777 (+ 2671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.373408 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.373416 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.373419 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.373558 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:55.373930 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:55.373935 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:55.373939 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:55.374211 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:55.374391 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:55.374744 (+ 353us) server_negotiation.cc:299] Negotiation successful
0619 06:38:55.374965 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
I20260619 06:38:55.375432 17923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.360507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:52338)
0619 06:38:55.364102 (+ 3595us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:55.364127 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:55.364302 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:55.364667 (+ 365us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:55.364672 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:55.365111 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:55.365322 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.365332 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.366405 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.366411 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.367479 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.367491 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.368239 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.368245 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.368424 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.369113 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:55.369131 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:55.369865 (+ 734us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:55.372929 (+ 3064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:55.372934 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:55.372939 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:55.373285 (+ 346us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:55.373666 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:55.373673 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:55.373677 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:55.373818 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:55.374327 (+ 509us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:55.374331 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:55.374509 (+ 178us) client_negotiation.cc:769] Sending connection context
0619 06:38:55.374657 (+ 148us) client_negotiation.cc:240] Negotiation successful
0619 06:38:55.374964 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3438,"thread_start_us":3346,"threads_started":1}
I20260619 06:38:55.376341 17180 tablet_copy_service.cc:140] P 54987b0b55b74c9585053e4148f4635a: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 9dbd17a454d34e55af9770b0e4565cf5 ({username='oryx', principal='oryx/127.10.192.124@KRBTEST.COM'} at 127.0.0.1:52338)
I20260619 06:38:55.376518 17180 tablet_copy_service.cc:161] P 54987b0b55b74c9585053e4148f4635a: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 9dbd17a454d34e55af9770b0e4565cf5 at {username='oryx', principal='oryx/127.10.192.124@KRBTEST.COM'} at 127.0.0.1:52338: session id = 9dbd17a454d34e55af9770b0e4565cf5-00000000000000000000000000000000
I20260619 06:38:55.379249 17180 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a: Tablet Copy: opened 0 blocks and 1 log segments
I20260619 06:38:55.380939 17726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260619 06:38:55.385584 17726 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: tablet copy: Starting download of 0 data blocks...
I20260619 06:38:55.385905 17726 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: tablet copy: Starting download of 1 WAL segments...
I20260619 06:38:55.388340 17726 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260619 06:38:55.392311 17180 tablet_copy_service.cc:342] P 54987b0b55b74c9585053e4148f4635a: Request end of tablet copy session 9dbd17a454d34e55af9770b0e4565cf5-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.10.192.124@KRBTEST.COM'} at 127.0.0.1:52338
I20260619 06:38:55.392473 17180 tablet_copy_service.cc:433] P 54987b0b55b74c9585053e4148f4635a: ending tablet copy session 9dbd17a454d34e55af9770b0e4565cf5-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 9dbd17a454d34e55af9770b0e4565cf5
I20260619 06:38:55.402757 17726 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:55.405521 17924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:55.406117 17925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:55.421281 17927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:55.423964 17726 server_base.cc:1034] running on GCE node
I20260619 06:38:55.424320 17726 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:55.425009 17726 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:55.426220 17726 hybrid_clock.cc:648] HybridClock initialized: now 1781851135426162 us; error 52 us; skew 500 ppm
I20260619 06:38:55.426512 17726 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:55 dist-test-slave-7lz4 krb5kdc[17115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851135, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:55.428768 17726 init.cc:377] Logged in from keytab as oryx/127.10.192.124@KRBTEST.COM (short username oryx)
I20260619 06:38:55.430089 17726 webserver.cc:460] Webserver started at http://127.10.192.124:35745/ using document root <none> and password file <none>
I20260619 06:38:55.430405 17726 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:55.430513 17726 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:55.433168 17726 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.003s sys 0.000s
I20260619 06:38:55.434849 17934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:55.435307 17726 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260619 06:38:55.435448 17726 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/wal
uuid: "9dbd17a454d34e55af9770b0e4565cf5"
format_stamp: "Formatted at 2026-06-19 06:38:55 on dist-test-slave-7lz4"
server_key: "123f5b254ebe5d54ef7a27f8a0a591d2"
server_key_iv: "79928c0196256155bc45ead8b06859cc"
server_key_version: "encryptionkey@0"
I20260619 06:38:55.435667 17726 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:55.447885 17726 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:55.451486 17726 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:55.470227 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 17221
I20260619 06:38:55.494778 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:42847
--local_ip_for_outbound_sockets=127.10.192.65
--tserver_master_addrs=127.10.192.126:33459
--webserver_port=38635
--webserver_interface=127.10.192.65
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.65.keytab
--principal=oryx/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:37949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.192.126:33459,127.10.192.125:37681
--tserver_master_addrs=127.10.192.126:33459,127.10.192.125:37681,127.10.192.124:35867 with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:38:55.498409 17726 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.124:35867
I20260619 06:38:55.498458 17985 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.124:35867 every 8 connection(s)
I20260619 06:38:55.499431 17726 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/master-2/data/info.pb
I20260619 06:38:55.508342 17986 sys_catalog.cc:263] Verifying existing consensus state
I20260619 06:38:55.513113 17986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: Bootstrap starting.
I20260619 06:38:55.528851 17986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 06:38:55.529414 17986 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: Bootstrap complete.
I20260619 06:38:55.530632 17986 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: NON_VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: true } }
I20260619 06:38:55.530890 17986 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 9dbd17a454d34e55af9770b0e4565cf5, State: Initialized, Role: LEARNER
I20260619 06:38:55.531150 17986 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: NON_VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: true } }
I20260619 06:38:55.532109 17990 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: NON_VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: true } } }
I20260619 06:38:55.532456 17986 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:38:55.532651 17990 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [sys.catalog]: This master's current role is: LEARNER
I20260619 06:38:55.549165 18001 catalog_manager.cc:1259] Loaded cluster ID: e0d8d3da0d5e4194a70beb96d7c6ec54
I20260619 06:38:55.549306 18001 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: loading cluster ID for follower catalog manager: success
I20260619 06:38:55.552016 18001 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: acquiring CA information for follower catalog manager: success
I20260619 06:38:55.554071 18001 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 06:38:55.823508 17908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.816478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:35867 (local address 127.0.0.1:55666)
0619 06:38:55.816769 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:55.816791 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:55.816948 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:55.817891 (+ 943us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:55.817897 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:55.817932 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:55.818122 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.818132 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.820024 (+ 1892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.820029 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.821184 (+ 1155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:55.821197 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.822947 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.822952 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:55.823084 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.823109 (+ 25us) client_negotiation.cc:769] Sending connection context
0619 06:38:55.823172 (+ 63us) client_negotiation.cc:240] Negotiation successful
0619 06:38:55.823284 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154}
I20260619 06:38:55.823750 18002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.816672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55666 (local address 127.10.192.124:35867)
0619 06:38:55.817502 (+ 830us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:55.817511 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:55.817533 (+ 22us) server_negotiation.cc:407] Connection header received
0619 06:38:55.817610 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:55.817615 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:55.817712 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:55.817838 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:55.818293 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.819847 (+ 1554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.821351 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:55.822766 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:55.822974 (+ 208us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:55.823178 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:55.823231 (+ 53us) server_negotiation.cc:299] Negotiation successful
0619 06:38:55.823368 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":694,"thread_start_us":505,"threads_started":1}
I20260619 06:38:55.824683 17961 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260619 06:38:55.825352 17990 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54987b0b55b74c9585053e4148f4635a. Latest consensus state: current_term: 1 leader_uuid: "54987b0b55b74c9585053e4148f4635a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: NON_VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: true } } }
I20260619 06:38:55.825661 17990 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [sys.catalog]: This master's current role is: LEARNER
W20260619 06:38:55.866272 17987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:55.866685 17987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:55.866873 17987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:55.874276 17987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:55.874384 17987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:55.874569 17987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:38:55.884770 17987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:37949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.65.keytab
--principal=oryx/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:42847
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=38635
--tserver_master_addrs=127.10.192.126:33459,127.10.192.125:37681,127.10.192.124:35867
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:55.886185 17987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:55.887548 17987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:55.901436 18008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:55.901474 18010 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:55.901474 18007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:55.902117 17987 server_base.cc:1034] running on GCE node
I20260619 06:38:55.902773 17987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:55.903821 17987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:55.905025 17987 hybrid_clock.cc:648] HybridClock initialized: now 1781851135904958 us; error 63 us; skew 500 ppm
I20260619 06:38:55.905437 17987 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:55 dist-test-slave-7lz4 krb5kdc[17115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851135, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:55.909379 17987 init.cc:377] Logged in from keytab as oryx/127.10.192.65@KRBTEST.COM (short username oryx)
I20260619 06:38:55.910939 17987 webserver.cc:460] Webserver started at http://127.10.192.65:38635/ using document root <none> and password file <none>
I20260619 06:38:55.911593 17987 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:55.911790 17987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:55.917335 17987 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260619 06:38:55.920135 18017 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:55.921554 17987 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 06:38:55.921734 17987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "bc6f36ed88f74d6588b1214661fc0bed"
format_stamp: "Formatted at 2026-06-19 06:38:52 on dist-test-slave-7lz4"
server_key: "a519f96f9fe3713c90c7cd000d519447"
server_key_iv: "8c26d2f235f62bfb1fdfeceb84ff2a0f"
server_key_version: "encryptionkey@0"
I20260619 06:38:55.922701 17987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:55.941880 17987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:55.947039 17987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:55.947341 17987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:55.948397 17987 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:55.949846 17987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:55.949945 17987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:55.950104 17987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:55.950207 17987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:55.986616 17987 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:42847
I20260619 06:38:55.986673 18129 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:42847 every 8 connection(s)
I20260619 06:38:55.988257 17987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:38:55.992753 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 17987
I20260619 06:38:55.993403 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 17355
Jun 19 06:38:56 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851135, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.124@KRBTEST.COM
Jun 19 06:38:56 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.192.66@KRBTEST.COM
Jun 19 06:38:56 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851135, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.125@KRBTEST.COM
Jun 19 06:38:56 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851135, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM
I20260619 06:38:56.025347 18002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.991867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:36377 (local address 127.10.192.124:35867)
0619 06:38:55.993334 (+ 1467us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:55.993344 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:55.998841 (+ 5497us) server_negotiation.cc:407] Connection header received
0619 06:38:55.999018 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:55.999027 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:55.999145 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:55.999269 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:56.002530 (+ 3261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.004052 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.007744 (+ 3692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.008712 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.008838 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:56.017721 (+ 8883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:56.017731 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:56.017738 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:56.017782 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:56.021191 (+ 3409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:56.022151 (+ 960us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:56.022159 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:56.022164 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:56.022313 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:56.022915 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:56.022922 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:56.022929 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:56.023346 (+ 417us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:56.023499 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:56.024685 (+ 1186us) server_negotiation.cc:299] Negotiation successful
0619 06:38:56.024965 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260619 06:38:56.027840 18138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.994874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49418 (local address 127.10.192.66:41223)
0619 06:38:55.999508 (+ 4634us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:55.999520 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:56.000399 (+ 879us) server_negotiation.cc:407] Connection header received
0619 06:38:56.000521 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:56.000535 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:56.000866 (+ 331us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:56.001073 (+ 207us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:56.004030 (+ 2957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.006115 (+ 2085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.008590 (+ 2475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.009674 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.009835 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:56.016719 (+ 6884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:56.016740 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:56.016764 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:56.016824 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:56.022569 (+ 5745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:56.024080 (+ 1511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:56.024091 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:56.024094 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:56.024291 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:56.024808 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:56.024813 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:56.024816 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:56.025255 (+ 439us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:56.026792 (+ 1537us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:56.027055 (+ 263us) server_negotiation.cc:299] Negotiation successful
0619 06:38:56.027406 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4380,"thread_start_us":4242,"threads_started":1}
I20260619 06:38:56.027942 18136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.992252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:35867 (local address 127.10.192.65:36377)
0619 06:38:55.998699 (+ 6447us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:55.998721 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:55.998867 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:55.999925 (+ 1058us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:55.999945 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:56.001153 (+ 1208us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:56.002232 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:56.002266 (+ 34us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.004401 (+ 2135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.004410 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:56.007503 (+ 3093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:56.007524 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.009277 (+ 1753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.009287 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:56.009709 (+ 422us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:56.010753 (+ 1044us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:56.010808 (+ 55us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:56.017392 (+ 6584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:56.021335 (+ 3943us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:56.021345 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:56.021363 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:56.022009 (+ 646us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:56.022453 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:56.022458 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:56.022463 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:56.022736 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:56.023582 (+ 846us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:56.023593 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:56.024161 (+ 568us) client_negotiation.cc:769] Sending connection context
0619 06:38:56.025590 (+ 1429us) client_negotiation.cc:240] Negotiation successful
0619 06:38:56.026241 (+ 651us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6245,"mutex_wait_us":34,"thread_start_us":1626,"threads_started":1}
I20260619 06:38:56.028651 18134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.991561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:41413 (local address 127.10.192.125:37681)
0619 06:38:56.010404 (+ 18843us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:56.010410 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:56.010435 (+ 25us) server_negotiation.cc:407] Connection header received
0619 06:38:56.010505 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:56.010511 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:56.010607 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:56.011250 (+ 643us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:56.012032 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.013264 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.015276 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.015939 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.016073 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:56.020607 (+ 4534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:56.020615 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:56.020620 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:56.020671 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:56.024668 (+ 3997us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:56.025582 (+ 914us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:56.025587 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:56.025590 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:56.025731 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:56.026189 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:56.026195 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:56.026198 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:56.026549 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:56.026690 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:56.028038 (+ 1348us) server_negotiation.cc:299] Negotiation successful
0619 06:38:56.028271 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18719,"thread_start_us":18609,"threads_started":1}
I20260619 06:38:56.028942 18135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.992252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:37681 (local address 127.10.192.65:41413)
0619 06:38:55.994490 (+ 2238us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:55.994541 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:55.997701 (+ 3160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:56.010807 (+ 13106us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:56.010815 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:56.011442 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:56.011841 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:56.011856 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.013449 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.013455 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:56.015099 (+ 1644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:56.015112 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.016168 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.016176 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:56.016427 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:56.017185 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:56.017209 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:56.020340 (+ 3131us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:56.024836 (+ 4496us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:56.024842 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:56.024846 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:56.025323 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:56.025862 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:56.025867 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:56.025873 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:56.026059 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:56.026763 (+ 704us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:56.026768 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:56.026929 (+ 161us) client_negotiation.cc:769] Sending connection context
0619 06:38:56.027058 (+ 129us) client_negotiation.cc:240] Negotiation successful
0619 06:38:56.027394 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1903,"spinlock_wait_cycles":11008,"thread_start_us":5954,"threads_started":1}
I20260619 06:38:56.029781 17478 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:56.029883 18132 heartbeater.cc:347] Connected to a master server at 127.10.192.125:37681
I20260619 06:38:56.030015 18130 heartbeater.cc:347] Connected to a master server at 127.10.192.124:35867
I20260619 06:38:56.030230 18130 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:56.031064 18130 heartbeater.cc:511] Master 127.10.192.124:35867 requested a full tablet report, sending...
I20260619 06:38:56.030234 18132 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:56.032143 18132 heartbeater.cc:511] Master 127.10.192.125:37681 requested a full tablet report, sending...
I20260619 06:38:56.034202 17951 ts_manager.cc:194] Registered new tserver with Master: bc6f36ed88f74d6588b1214661fc0bed (127.10.192.65:42847)
I20260619 06:38:56.034192 17762 ts_manager.cc:194] Registered new tserver with Master: bc6f36ed88f74d6588b1214661fc0bed (127.10.192.65:42847)
I20260619 06:38:56.039407 18139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.995527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:40841 (local address 127.10.192.126:33459)
0619 06:38:56.015791 (+ 20264us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:56.015799 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:56.015818 (+ 19us) server_negotiation.cc:407] Connection header received
0619 06:38:56.015873 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:56.015878 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:56.015955 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:56.016070 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:56.017820 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.019005 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.021183 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.021789 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.021917 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:56.026327 (+ 4410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:56.026334 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:56.026339 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:56.026543 (+ 204us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:56.036159 (+ 9616us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:56.037157 (+ 998us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:56.037177 (+ 20us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:56.037184 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:56.037334 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:56.037819 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:56.037822 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:56.037824 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:56.038142 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:56.038252 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:56.038796 (+ 544us) server_negotiation.cc:299] Negotiation successful
0619 06:38:56.039047 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20131,"thread_start_us":20008,"threads_started":1}
I20260619 06:38:56.039466 18140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:55.996743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.65:40841)
0619 06:38:56.015166 (+ 18423us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:56.015188 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:56.015297 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:56.016246 (+ 949us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:56.016253 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:56.017276 (+ 1023us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:56.017657 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:56.017671 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.019167 (+ 1496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.019175 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:56.021013 (+ 1838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:56.021029 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.022191 (+ 1162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.022199 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:56.022385 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:56.022982 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:56.023006 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:56.026116 (+ 3110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:56.036316 (+ 10200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:56.036323 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:56.036328 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:56.036987 (+ 659us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:56.037459 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:56.037465 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:56.037471 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:56.037690 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:56.038274 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:56.038281 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:56.038477 (+ 196us) client_negotiation.cc:769] Sending connection context
0619 06:38:56.038644 (+ 167us) client_negotiation.cc:240] Negotiation successful
0619 06:38:56.038995 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18279,"thread_start_us":18086,"threads_started":1}
I20260619 06:38:56.040387 18131 heartbeater.cc:347] Connected to a master server at 127.10.192.126:33459
I20260619 06:38:56.040539 18131 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:56.040941 18131 heartbeater.cc:511] Master 127.10.192.126:33459 requested a full tablet report, sending...
I20260619 06:38:56.042253 17160 ts_manager.cc:194] Re-registered known tserver with Master: bc6f36ed88f74d6588b1214661fc0bed (127.10.192.65:42847)
I20260619 06:38:56.043716 17160 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:40841
I20260619 06:38:56.117695 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 17355
I20260619 06:38:56.134997 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:41223
--local_ip_for_outbound_sockets=127.10.192.66
--tserver_master_addrs=127.10.192.126:33459
--webserver_port=43925
--webserver_interface=127.10.192.66
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.66.keytab
--principal=oryx/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:37949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.192.126:33459,127.10.192.125:37681
--tserver_master_addrs=127.10.192.126:33459,127.10.192.125:37681,127.10.192.124:35867 with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:38:56.426667 17912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "54987b0b55b74c9585053e4148f4635a" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: NON_VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: true } } }
I20260619 06:38:56.427137 17912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:56.428696 18143 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a: attempting to promote NON_VOTER 9dbd17a454d34e55af9770b0e4565cf5 to VOTER
I20260619 06:38:56.429302 18143 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } }
I20260619 06:38:56.431475 17961 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 1 LEARNER]: Refusing update from remote peer 54987b0b55b74c9585053e4148f4635a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260619 06:38:56.431474 17772 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 1 FOLLOWER]: Refusing update from remote peer 54987b0b55b74c9585053e4148f4635a: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260619 06:38:56.432154 18144 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [LEADER]: Connected to new peer: Peer: permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260619 06:38:56.432658 17912 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260619 06:38:56.435459 17912 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 9dbd17a454d34e55af9770b0e4565cf5 (127.10.192.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } } }
I20260619 06:38:56.436111 17772 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 9dbd17a454d34e55af9770b0e4565cf5 (127.10.192.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } } }
I20260619 06:38:56.438608 17912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "54987b0b55b74c9585053e4148f4635a" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } } }
I20260619 06:38:56.438910 17912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:56.439141 17912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "54987b0b55b74c9585053e4148f4635a" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } } }
I20260619 06:38:56.439441 17912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:56.441380 18150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "54987b0b55b74c9585053e4148f4635a" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } } }
I20260619 06:38:56.441556 18143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "54987b0b55b74c9585053e4148f4635a" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } } }
I20260619 06:38:56.441790 18143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a [sys.catalog]: This master's current role is: LEADER
I20260619 06:38:56.442243 17961 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 9dbd17a454d34e55af9770b0e4565cf5 (127.10.192.124) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } } }
I20260619 06:38:56.444919 18150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:38:56.447788 18151 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "54987b0b55b74c9585053e4148f4635a" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } } }
I20260619 06:38:56.448132 18151 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [sys.catalog]: This master's current role is: FOLLOWER
W20260619 06:38:56.478534 18142 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:56.478832 18142 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:56.479004 18142 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:56.486249 18142 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:56.486370 18142 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:56.486546 18142 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:38:56.498064 18142 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:37949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.66.keytab
--principal=oryx/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:41223
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=43925
--tserver_master_addrs=127.10.192.126:33459,127.10.192.125:37681,127.10.192.124:35867
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:56.499817 18142 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:56.501560 18142 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:56.517128 18156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:56.517158 18159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:56.517192 18157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:56.517976 18142 server_base.cc:1034] running on GCE node
I20260619 06:38:56.518666 18142 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:56.519733 18142 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:56.520979 18142 hybrid_clock.cc:648] HybridClock initialized: now 1781851136520925 us; error 61 us; skew 500 ppm
I20260619 06:38:56.521342 18142 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:56 dist-test-slave-7lz4 krb5kdc[17115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851136, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:56.524559 18142 init.cc:377] Logged in from keytab as oryx/127.10.192.66@KRBTEST.COM (short username oryx)
I20260619 06:38:56.526301 18142 webserver.cc:460] Webserver started at http://127.10.192.66:43925/ using document root <none> and password file <none>
I20260619 06:38:56.527256 18142 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:56.527422 18142 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:56.533007 18142 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s
I20260619 06:38:56.536087 18166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:56.537747 18142 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 06:38:56.537966 18142 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "776283177ae340d790862761bc824aff"
format_stamp: "Formatted at 2026-06-19 06:38:53 on dist-test-slave-7lz4"
server_key: "ab1860661ea36cb6fc3fd355a3236b7d"
server_key_iv: "fb1727ad67aaa4da110f51f9754286be"
server_key_version: "encryptionkey@0"
I20260619 06:38:56.538988 18142 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:56.553448 18142 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:56.557674 18142 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:56.557996 18142 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:56.559032 18142 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:56.560499 18142 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:56.560622 18142 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:56.560751 18142 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:56.560842 18142 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:56.594866 18142 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:41223
I20260619 06:38:56.594962 18278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:41223 every 8 connection(s)
I20260619 06:38:56.596494 18142 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:38:56.607087 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 18142
I20260619 06:38:56.607460 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 17489
Jun 19 06:38:56 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851136, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.125@KRBTEST.COM
Jun 19 06:38:56 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851136, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM
Jun 19 06:38:56 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851136, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.124@KRBTEST.COM
Jun 19 06:38:56 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851131, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.192.67@KRBTEST.COM
I20260619 06:38:56.653848 18284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:56.599481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:35045 (local address 127.10.192.125:37681)
0619 06:38:56.626584 (+ 27103us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:56.626594 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:56.626625 (+ 31us) server_negotiation.cc:407] Connection header received
0619 06:38:56.626722 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:56.626731 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:56.626847 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:56.627048 (+ 201us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:56.631087 (+ 4039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.632663 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.635900 (+ 3237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.636571 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.636688 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:56.643567 (+ 6879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:56.643577 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:56.643583 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:56.643669 (+ 86us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:56.647707 (+ 4038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:56.650336 (+ 2629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:56.650343 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:56.650347 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:56.650521 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:56.651761 (+ 1240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:56.651769 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:56.651774 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:56.652155 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:56.652300 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:56.653227 (+ 927us) server_negotiation.cc:299] Negotiation successful
0619 06:38:56.653480 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26925,"thread_start_us":27727,"threads_started":1}
I20260619 06:38:56.653949 18289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:56.616048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:44395 (local address 127.10.192.124:35867)
0619 06:38:56.628977 (+ 12929us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:56.628985 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:56.633738 (+ 4753us) server_negotiation.cc:407] Connection header received
0619 06:38:56.634784 (+ 1046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:56.634791 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:56.634881 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:56.634968 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:56.636361 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.637538 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.639856 (+ 2318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.640537 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.640630 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:56.645866 (+ 5236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:56.645872 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:56.645878 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:56.645934 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:56.649481 (+ 3547us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:56.650900 (+ 1419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:56.650906 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:56.650909 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:56.651031 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:56.651593 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:56.651599 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:56.651604 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:56.651969 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:56.652142 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:56.653254 (+ 1112us) server_negotiation.cc:299] Negotiation successful
0619 06:38:56.653491 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12772,"thread_start_us":12926,"threads_started":1}
I20260619 06:38:56.655303 18288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:56.608793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50192 (local address 127.10.192.67:35425)
0619 06:38:56.624349 (+ 15556us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:56.624364 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:56.629680 (+ 5316us) server_negotiation.cc:407] Connection header received
0619 06:38:56.629929 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:56.629945 (+ 16us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:56.630320 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:56.630495 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:56.634428 (+ 3933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.635988 (+ 1560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.638287 (+ 2299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.638925 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.639091 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:56.646776 (+ 7685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:56.646800 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:56.646820 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:56.646868 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:56.651159 (+ 4291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:56.652092 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:56.652103 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:56.652106 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:56.652289 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:56.652729 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:56.652734 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:56.652738 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:56.653186 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:56.653467 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:56.654652 (+ 1185us) server_negotiation.cc:299] Negotiation successful
0619 06:38:56.654927 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15272,"thread_start_us":15576,"threads_started":1}
I20260619 06:38:56.655825 18286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:56.600053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:37681 (local address 127.10.192.66:35045)
0619 06:38:56.610468 (+ 10415us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:56.610541 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:56.613930 (+ 3389us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:56.627913 (+ 13983us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:56.627958 (+ 45us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:56.629335 (+ 1377us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:56.630733 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:56.630786 (+ 53us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.633023 (+ 2237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.633032 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:56.635699 (+ 2667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:56.635716 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.637129 (+ 1413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.637138 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:56.637489 (+ 351us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:56.639440 (+ 1951us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:56.639477 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:56.643205 (+ 3728us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:56.647902 (+ 4697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:56.647914 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:56.647936 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:56.650211 (+ 2275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:56.651431 (+ 1220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:56.651434 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:56.651436 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:56.651622 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:56.652385 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:56.652392 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:56.652828 (+ 436us) client_negotiation.cc:769] Sending connection context
0619 06:38:56.654121 (+ 1293us) client_negotiation.cc:240] Negotiation successful
0619 06:38:56.654448 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9949,"mutex_wait_us":28,"spinlock_wait_cycles":5120,"thread_start_us":33525,"threads_started":1}
I20260619 06:38:56.656060 18285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:56.622103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:35867 (local address 127.10.192.66:44395)
0619 06:38:56.633628 (+ 11525us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:56.633647 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:56.634601 (+ 954us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:56.635189 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:56.635193 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:56.635850 (+ 657us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:56.636193 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:56.636206 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.637719 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.637724 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:56.639706 (+ 1982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:56.639719 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.640915 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.640923 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:56.641126 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:56.641761 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:56.641784 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:56.645632 (+ 3848us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:56.650328 (+ 4696us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:56.650335 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:56.650338 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:56.650765 (+ 427us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:56.651141 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:56.651146 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:56.651149 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:56.651444 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:56.652224 (+ 780us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:56.652233 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:56.652825 (+ 592us) client_negotiation.cc:769] Sending connection context
0619 06:38:56.653131 (+ 306us) client_negotiation.cc:240] Negotiation successful
0619 06:38:56.653701 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11386,"mutex_wait_us":32,"spinlock_wait_cycles":1792,"thread_start_us":5981,"threads_started":1}
I20260619 06:38:56.656122 18290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:56.600053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.66:51603)
0619 06:38:56.627832 (+ 27779us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:56.627858 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:56.628011 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:56.634433 (+ 6422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:56.634437 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:56.635100 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:56.635484 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:56.635502 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.637112 (+ 1610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.637117 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:56.638815 (+ 1698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:56.638830 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.640075 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.640081 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:56.640614 (+ 533us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:56.642076 (+ 1462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:56.642108 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:56.646093 (+ 3985us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:56.650683 (+ 4590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:56.650688 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:56.650691 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:56.651295 (+ 604us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:56.652463 (+ 1168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:56.652468 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:56.652471 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:56.652617 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:56.654274 (+ 1657us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:56.654280 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:56.654447 (+ 167us) client_negotiation.cc:769] Sending connection context
0619 06:38:56.654615 (+ 168us) client_negotiation.cc:240] Negotiation successful
0619 06:38:56.654912 (+ 297us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27576,"mutex_wait_us":37,"spinlock_wait_cycles":60672,"thread_start_us":14276,"threads_started":1}
I20260619 06:38:56.656252 18283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:56.599360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:51603 (local address 127.10.192.126:33459)
0619 06:38:56.634098 (+ 34738us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:56.634106 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:56.634128 (+ 22us) server_negotiation.cc:407] Connection header received
0619 06:38:56.634187 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:56.634192 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:56.634286 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:56.634410 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:56.635707 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.636916 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.639010 (+ 2094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:56.639706 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:56.639837 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:56.646310 (+ 6473us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:56.646319 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:56.646326 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:56.646381 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:56.650157 (+ 3776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:56.652068 (+ 1911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:56.652074 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:56.652078 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:56.652231 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:56.653530 (+ 1299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:56.653535 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:56.653537 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:56.653858 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:56.654004 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:56.655612 (+ 1608us) server_negotiation.cc:299] Negotiation successful
0619 06:38:56.655903 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34613,"thread_start_us":34514,"threads_started":1}
I20260619 06:38:56.657509 18281 heartbeater.cc:347] Connected to a master server at 127.10.192.125:37681
I20260619 06:38:56.657796 18281 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:56.658547 18279 heartbeater.cc:347] Connected to a master server at 127.10.192.124:35867
I20260619 06:38:56.658627 18281 heartbeater.cc:511] Master 127.10.192.125:37681 requested a full tablet report, sending...
I20260619 06:38:56.658670 17612 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:56.658712 18279 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:56.659284 18279 heartbeater.cc:511] Master 127.10.192.124:35867 requested a full tablet report, sending...
I20260619 06:38:56.659544 18280 heartbeater.cc:347] Connected to a master server at 127.10.192.126:33459
I20260619 06:38:56.659695 18280 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:56.660132 18280 heartbeater.cc:511] Master 127.10.192.126:33459 requested a full tablet report, sending...
I20260619 06:38:56.660490 17762 ts_manager.cc:194] Registered new tserver with Master: 776283177ae340d790862761bc824aff (127.10.192.66:41223)
I20260619 06:38:56.660853 17951 ts_manager.cc:194] Registered new tserver with Master: 776283177ae340d790862761bc824aff (127.10.192.66:41223)
I20260619 06:38:56.661746 17160 ts_manager.cc:194] Re-registered known tserver with Master: 776283177ae340d790862761bc824aff (127.10.192.66:41223)
I20260619 06:38:56.662639 17160 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:51603
I20260619 06:38:56.751776 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 17489
I20260619 06:38:56.767581 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:35425
--local_ip_for_outbound_sockets=127.10.192.67
--tserver_master_addrs=127.10.192.126:33459
--webserver_port=34953
--webserver_interface=127.10.192.67
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.67.keytab
--principal=oryx/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:37949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.10.192.126:33459,127.10.192.125:37681
--tserver_master_addrs=127.10.192.126:33459,127.10.192.125:37681,127.10.192.124:35867 with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:38:57.046370 18131 heartbeater.cc:503] Master 127.10.192.126:33459 was elected leader, sending a full tablet report...
W20260619 06:38:57.105414 18292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:38:57.105705 18292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:38:57.105799 18292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:38:57.113336 18292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:38:57.113462 18292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:38:57.113585 18292 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:38:57.124094 18292 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:37949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.67.keytab
--principal=oryx/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:35425
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=34953
--tserver_master_addrs=127.10.192.126:33459,127.10.192.125:37681,127.10.192.124:35867
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:38:57.125403 18292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:38:57.126765 18292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:38:57.140290 18297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:57.140343 18298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:38:57.140313 18300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:38:57.141409 18292 server_base.cc:1034] running on GCE node
I20260619 06:38:57.141995 18292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:38:57.142977 18292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:38:57.144196 18292 hybrid_clock.cc:648] HybridClock initialized: now 1781851137144138 us; error 57 us; skew 500 ppm
I20260619 06:38:57.144564 18292 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:38:57 dist-test-slave-7lz4 krb5kdc[17115](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851137, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:38:57.147823 18292 init.cc:377] Logged in from keytab as oryx/127.10.192.67@KRBTEST.COM (short username oryx)
I20260619 06:38:57.149470 18292 webserver.cc:460] Webserver started at http://127.10.192.67:34953/ using document root <none> and password file <none>
I20260619 06:38:57.150251 18292 fs_manager.cc:359] Metadata directory not provided
I20260619 06:38:57.150391 18292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:38:57.156267 18292 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260619 06:38:57.159364 18307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:57.160877 18292 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:38:57.161033 18292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "40d10e23a819488ab3a62103a775c085"
format_stamp: "Formatted at 2026-06-19 06:38:53 on dist-test-slave-7lz4"
server_key: "953ccf16cfc68745a6006c613b13ad24"
server_key_iv: "bbb2ed4fb90f23dd5f41bee3e170341a"
server_key_version: "encryptionkey@0"
I20260619 06:38:57.162019 18292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:38:57.178082 18292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:38:57.182363 18292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:38:57.182605 18292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:38:57.183494 18292 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:38:57.184856 18292 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:38:57.184939 18292 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:57.185017 18292 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:38:57.185073 18292 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:38:57.218562 18292 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:35425
I20260619 06:38:57.218657 18419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:35425 every 8 connection(s)
I20260619 06:38:57.220139 18292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:38:57.228909 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 18292
Jun 19 06:38:57 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851137, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.124@KRBTEST.COM
Jun 19 06:38:57 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851137, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.125@KRBTEST.COM
I20260619 06:38:57.315258 18432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.251305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52340 (local address 127.10.192.126:33459)
0619 06:38:57.281716 (+ 30411us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:57.281725 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:57.281753 (+ 28us) server_negotiation.cc:407] Connection header received
0619 06:38:57.281834 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:57.281842 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:57.281964 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:57.282107 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:57.290283 (+ 8176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.291712 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.295335 (+ 3623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.296049 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.296705 (+ 656us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.306309 (+ 9604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:57.306317 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:57.306324 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:57.306368 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:57.310726 (+ 4358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.311607 (+ 881us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.311613 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.311616 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.312126 (+ 510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.312743 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.312750 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.312756 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.313153 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:57.313365 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:57.313882 (+ 517us) server_negotiation.cc:299] Negotiation successful
0619 06:38:57.314125 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30224,"thread_start_us":32699,"threads_started":1}
I20260619 06:38:57.316943 18424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.223206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:56157 (local address 127.10.192.124:35867)
0619 06:38:57.297241 (+ 74035us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:57.297247 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:57.297265 (+ 18us) server_negotiation.cc:407] Connection header received
0619 06:38:57.297324 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:57.297328 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:57.297447 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:57.297570 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:57.299125 (+ 1555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.300695 (+ 1570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.303495 (+ 2800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.304123 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.304259 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.308655 (+ 4396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:57.308663 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:57.308669 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:57.308714 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:57.312647 (+ 3933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.313659 (+ 1012us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.313662 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.313665 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.313829 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.314379 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.314383 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.314386 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.314725 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:57.314864 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:57.316229 (+ 1365us) server_negotiation.cc:299] Negotiation successful
0619 06:38:57.316465 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73892,"thread_start_us":74457,"threads_started":1}
I20260619 06:38:57.319653 18427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.223969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:35867 (local address 127.10.192.67:56157)
0619 06:38:57.295818 (+ 71849us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:57.295840 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:57.295955 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:57.297661 (+ 1706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:57.297669 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:57.298472 (+ 803us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:57.298886 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:57.298902 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.300928 (+ 2026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.300937 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:57.303332 (+ 2395us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:57.303343 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.304384 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.304393 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:57.304667 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.305485 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:57.305508 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:57.308392 (+ 2884us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:57.312810 (+ 4418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:57.312820 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:57.312844 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:57.313531 (+ 687us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:57.313963 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:57.313967 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:57.313970 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:57.314225 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:57.314946 (+ 721us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:57.314955 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:57.315821 (+ 866us) client_negotiation.cc:769] Sending connection context
0619 06:38:57.316157 (+ 336us) client_negotiation.cc:240] Negotiation successful
0619 06:38:57.316686 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71652,"mutex_wait_us":39,"thread_start_us":71274,"threads_started":1}
Jun 19 06:38:57 dist-test-slave-7lz4 krb5kdc[17115](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851137, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM
I20260619 06:38:57.339198 18424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.297850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55680 (local address 127.10.192.124:35867)
0619 06:38:57.317175 (+ 19325us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:57.317181 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:57.317198 (+ 17us) server_negotiation.cc:407] Connection header received
0619 06:38:57.317240 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:57.317244 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:57.317349 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:57.320976 (+ 3627us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:57.321120 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.322177 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.325051 (+ 2874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.325861 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.326526 (+ 665us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.329546 (+ 3020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:57.329552 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:57.329558 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:57.329602 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:57.334288 (+ 4686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.335986 (+ 1698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.335991 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.335994 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.336152 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.336604 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.336609 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.336613 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.337084 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:57.338330 (+ 1246us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:57.338483 (+ 153us) server_negotiation.cc:299] Negotiation successful
0619 06:38:57.338711 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19230,"thread_start_us":41052,"threads_started":1}
I20260619 06:38:57.340235 18420 heartbeater.cc:347] Connected to a master server at 127.10.192.124:35867
I20260619 06:38:57.340600 18420 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:57.341631 18420 heartbeater.cc:511] Master 127.10.192.124:35867 requested a full tablet report, sending...
I20260619 06:38:57.341886 18426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.223969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:37681 (local address 127.10.192.67:40089)
0619 06:38:57.285610 (+ 61641us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:57.285666 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:57.288056 (+ 2390us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:57.289327 (+ 1271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:57.289344 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:57.291902 (+ 2558us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:57.292954 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:57.292987 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.294633 (+ 1646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.294638 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:57.306370 (+ 11732us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:57.306391 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.309074 (+ 2683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.309083 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:57.309333 (+ 250us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.312326 (+ 2993us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:57.312351 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:57.320455 (+ 8104us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:57.336865 (+ 16410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:57.336873 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:57.336879 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:57.337559 (+ 680us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:57.339146 (+ 1587us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:57.339152 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:57.339156 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:57.339602 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:57.340715 (+ 1113us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:57.340721 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:57.340893 (+ 172us) client_negotiation.cc:769] Sending connection context
0619 06:38:57.341040 (+ 147us) client_negotiation.cc:240] Negotiation successful
0619 06:38:57.341354 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61271,"thread_start_us":60995,"threads_started":1}
I20260619 06:38:57.342193 18434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.223304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:40089 (local address 127.10.192.125:37681)
0619 06:38:57.283611 (+ 60307us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:57.283620 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:57.287355 (+ 3735us) server_negotiation.cc:407] Connection header received
0619 06:38:57.288550 (+ 1195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:57.288558 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:57.288653 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:57.288769 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:57.293199 (+ 4430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.294429 (+ 1230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.307567 (+ 13138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.308530 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.308659 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.324550 (+ 15891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:57.324561 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:57.324569 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:57.324629 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:57.335874 (+ 11245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.337747 (+ 1873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.337755 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.337762 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.337978 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.339748 (+ 1770us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.339754 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.339758 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.340574 (+ 816us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:57.340779 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:57.341177 (+ 398us) server_negotiation.cc:299] Negotiation successful
0619 06:38:57.341429 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60135,"thread_start_us":72845,"threads_started":1}
I20260619 06:38:57.343083 18422 heartbeater.cc:347] Connected to a master server at 127.10.192.125:37681
I20260619 06:38:57.343214 18422 heartbeater.cc:464] Registering TS with master...
I20260619 06:38:57.343675 18422 heartbeater.cc:511] Master 127.10.192.125:37681 requested a full tablet report, sending...
I20260619 06:38:57.343948 17950 ts_manager.cc:194] Registered new tserver with Master: 40d10e23a819488ab3a62103a775c085 (127.10.192.67:35425)
I20260619 06:38:57.344832 17762 ts_manager.cc:194] Registered new tserver with Master: 40d10e23a819488ab3a62103a775c085 (127.10.192.67:35425)
I20260619 06:38:57.335942 17160 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52340:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260619 06:38:57.346164 18437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.296238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.67:46779)
0619 06:38:57.302797 (+ 6559us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:57.302816 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:57.302924 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:57.317305 (+ 14381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:57.317310 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:57.317886 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:38:57.318217 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:57.318232 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.320913 (+ 2681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.320921 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:57.322466 (+ 1545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:57.322480 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.324475 (+ 1995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.324481 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:57.324724 (+ 243us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.326627 (+ 1903us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:38:57.326653 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:38:57.330815 (+ 4162us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:38:57.335212 (+ 4397us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:57.335220 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:57.335225 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:57.335802 (+ 577us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:57.340096 (+ 4294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:38:57.340101 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:38:57.340106 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:38:57.340273 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:38:57.345136 (+ 4863us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:38:57.345142 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:38:57.345329 (+ 187us) client_negotiation.cc:769] Sending connection context
0619 06:38:57.345456 (+ 127us) client_negotiation.cc:240] Negotiation successful
0619 06:38:57.345747 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6429,"thread_start_us":6759,"threads_started":1}
I20260619 06:38:57.346724 18432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.296329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:46779 (local address 127.10.192.126:33459)
0619 06:38:57.315486 (+ 19157us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:57.315491 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:57.315508 (+ 17us) server_negotiation.cc:407] Connection header received
0619 06:38:57.315586 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:57.315590 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:57.315687 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:57.315786 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:57.319675 (+ 3889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.320769 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.323585 (+ 2816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.324196 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.324326 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.331092 (+ 6766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:57.331102 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:57.331112 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:57.331159 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:57.334917 (+ 3758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.339797 (+ 4880us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.339802 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.339805 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.339977 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.344355 (+ 4378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.344361 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.344364 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.344754 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:57.344911 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:57.346027 (+ 1116us) server_negotiation.cc:299] Negotiation successful
0619 06:38:57.346345 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19063,"thread_start_us":25055,"threads_started":1}
I20260619 06:38:57.347558 18421 heartbeater.cc:347] Connected to a master server at 127.10.192.126:33459
I20260619 06:38:57.347707 18421 heartbeater.cc:464] Registering TS with master...
W20260619 06:38:57.347968 17160 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:38:57.348150 18421 heartbeater.cc:511] Master 127.10.192.126:33459 requested a full tablet report, sending...
I20260619 06:38:57.349171 17159 ts_manager.cc:194] Re-registered known tserver with Master: 40d10e23a819488ab3a62103a775c085 (127.10.192.67:35425)
I20260619 06:38:57.350365 17159 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:46779
I20260619 06:38:57.353122 18425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.258399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58292 (local address 127.10.192.125:37681)
0619 06:38:57.296408 (+ 38009us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:57.296416 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:57.296445 (+ 29us) server_negotiation.cc:407] Connection header received
0619 06:38:57.296509 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:57.296517 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:57.296617 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:57.296715 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:57.310386 (+ 13671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.315232 (+ 4846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.318369 (+ 3137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.319301 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.336136 (+ 16835us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.336478 (+ 342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:57.336487 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:57.336495 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:57.336540 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:57.347955 (+ 11415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.350951 (+ 2996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.350957 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.350961 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.351114 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.351526 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.351531 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.351535 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.351896 (+ 361us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:57.352141 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:57.352521 (+ 380us) server_negotiation.cc:299] Negotiation successful
0619 06:38:57.352743 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37878,"thread_start_us":25247,"threads_started":1}
I20260619 06:38:57.387074 18452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.368973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:35425 (local address 127.0.0.1:50206)
0619 06:38:57.377870 (+ 8897us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:57.377893 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:57.378083 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:57.378759 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:57.378762 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:57.378787 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:57.379155 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:57.379163 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.381768 (+ 2605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.381772 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:57.383920 (+ 2148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:57.383933 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.386425 (+ 2492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.386430 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:57.386561 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.386586 (+ 25us) client_negotiation.cc:769] Sending connection context
0619 06:38:57.386652 (+ 66us) client_negotiation.cc:240] Negotiation successful
0619 06:38:57.386748 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8749,"mutex_wait_us":97,"thread_start_us":7472,"threads_started":1}
I20260619 06:38:57.387346 18451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.369578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50206 (local address 127.10.192.67:35425)
0619 06:38:57.370375 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:57.370389 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:57.378067 (+ 7678us) server_negotiation.cc:407] Connection header received
0619 06:38:57.378247 (+ 180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:57.378256 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:57.378542 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:57.378737 (+ 195us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:57.379333 (+ 596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.381381 (+ 2048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.384087 (+ 2706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.386223 (+ 2136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.386401 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.386693 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:57.386787 (+ 94us) server_negotiation.cc:299] Negotiation successful
0619 06:38:57.386988 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":560,"thread_start_us":349,"threads_started":1}
I20260619 06:38:57.390981 18450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.369014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49428 (local address 127.10.192.66:41223)
0619 06:38:57.376231 (+ 7217us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:57.376247 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:57.376831 (+ 584us) server_negotiation.cc:407] Connection header received
0619 06:38:57.377429 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:57.377442 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:57.377778 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:57.377932 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:57.378754 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.381333 (+ 2579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.388511 (+ 7178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.389961 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.390103 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.390307 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:57.390544 (+ 237us) server_negotiation.cc:299] Negotiation successful
0619 06:38:57.390709 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6977,"thread_start_us":6843,"threads_started":1}
I20260619 06:38:57.391045 18449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.368814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:41223 (local address 127.0.0.1:49428)
0619 06:38:57.376713 (+ 7899us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:57.376735 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:57.377177 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:57.378224 (+ 1047us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:57.378228 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:57.378254 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:57.378563 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:57.378580 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.381854 (+ 3274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.381859 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:57.388314 (+ 6455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:57.388328 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.390161 (+ 1833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.390167 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:57.390350 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.390384 (+ 34us) client_negotiation.cc:769] Sending connection context
0619 06:38:57.390475 (+ 91us) client_negotiation.cc:240] Negotiation successful
0619 06:38:57.390604 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7759,"mutex_wait_us":95,"thread_start_us":18611,"threads_started":1}
I20260619 06:38:57.391675 18355 tablet_service.cc:1467] Processing CreateTablet for tablet 5ef0050bb94a4c1ca924d3b51fe02435 (DEFAULT_TABLE table=test-table [id=1f09307742b945f69917b2e76e867843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:57.393272 18355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ef0050bb94a4c1ca924d3b51fe02435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:57.394733 18214 tablet_service.cc:1467] Processing CreateTablet for tablet 5ef0050bb94a4c1ca924d3b51fe02435 (DEFAULT_TABLE table=test-table [id=1f09307742b945f69917b2e76e867843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:57.395510 18448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.376855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:42847 (local address 127.0.0.1:33512)
0619 06:38:57.387317 (+ 10462us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:57.387345 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:57.387583 (+ 238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:57.388597 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:57.388602 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:57.388628 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:57.388992 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:57.389003 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.390916 (+ 1913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.390922 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:57.392642 (+ 1720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:57.392656 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.394725 (+ 2069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.394735 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:57.394906 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.394951 (+ 45us) client_negotiation.cc:769] Sending connection context
0619 06:38:57.395041 (+ 90us) client_negotiation.cc:240] Negotiation successful
0619 06:38:57.395176 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10323,"thread_start_us":682,"threads_started":1}
I20260619 06:38:57.395924 18453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.377114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33512 (local address 127.10.192.65:42847)
0619 06:38:57.382589 (+ 5475us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:57.382600 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:57.387455 (+ 4855us) server_negotiation.cc:407] Connection header received
0619 06:38:57.387819 (+ 364us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:57.387828 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:57.388097 (+ 269us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:57.388311 (+ 214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:57.389536 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.390743 (+ 1207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.392811 (+ 2068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.394218 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.394357 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.394560 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:57.395421 (+ 861us) server_negotiation.cc:299] Negotiation successful
0619 06:38:57.395591 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4299,"thread_start_us":4189,"threads_started":1}
I20260619 06:38:57.396081 18214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ef0050bb94a4c1ca924d3b51fe02435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:57.399489 18065 tablet_service.cc:1467] Processing CreateTablet for tablet 5ef0050bb94a4c1ca924d3b51fe02435 (DEFAULT_TABLE table=test-table [id=1f09307742b945f69917b2e76e867843]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:38:57.400863 18065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5ef0050bb94a4c1ca924d3b51fe02435. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:38:57.408039 18454 tablet_bootstrap.cc:492] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff: Bootstrap starting.
I20260619 06:38:57.411943 18454 tablet_bootstrap.cc:654] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:57.412415 18455 tablet_bootstrap.cc:492] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085: Bootstrap starting.
I20260619 06:38:57.413664 18454 log.cc:824] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:57.415954 18455 tablet_bootstrap.cc:654] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:57.416842 18457 tablet_bootstrap.cc:492] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed: Bootstrap starting.
I20260619 06:38:57.416903 18454 tablet_bootstrap.cc:492] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff: No bootstrap required, opened a new log
I20260619 06:38:57.417198 18455 log.cc:824] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:57.417691 18454 ts_tablet_manager.cc:1397] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.006s
I20260619 06:38:57.420321 18457 tablet_bootstrap.cc:654] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed: Neither blocks nor log segments found. Creating new log.
I20260619 06:38:57.420413 18455 tablet_bootstrap.cc:492] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085: No bootstrap required, opened a new log
I20260619 06:38:57.420696 18455 ts_tablet_manager.cc:1397] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s
I20260619 06:38:57.421622 18457 log.cc:824] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed: Log is configured to *not* fsync() on all Append() calls
I20260619 06:38:57.424134 18457 tablet_bootstrap.cc:492] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed: No bootstrap required, opened a new log
I20260619 06:38:57.424399 18457 ts_tablet_manager.cc:1397] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260619 06:38:57.428658 18454 raft_consensus.cc:348] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } }
I20260619 06:38:57.429126 18454 raft_consensus.cc:374] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:57.429225 18454 raft_consensus.cc:729] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 776283177ae340d790862761bc824aff, State: Initialized, Role: FOLLOWER
I20260619 06:38:57.429942 18454 consensus_queue.cc:260] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } }
I20260619 06:38:57.431242 18455 raft_consensus.cc:348] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } }
I20260619 06:38:57.431717 18455 raft_consensus.cc:374] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:57.431823 18455 raft_consensus.cc:729] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40d10e23a819488ab3a62103a775c085, State: Initialized, Role: FOLLOWER
I20260619 06:38:57.431864 18454 ts_tablet_manager.cc:1428] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff: Time spent starting tablet: real 0.014s user 0.013s sys 0.001s
I20260619 06:38:57.432130 18280 heartbeater.cc:503] Master 127.10.192.126:33459 was elected leader, sending a full tablet report...
I20260619 06:38:57.432439 18455 consensus_queue.cc:260] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } }
I20260619 06:38:57.432734 18457 raft_consensus.cc:348] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } }
I20260619 06:38:57.433218 18457 raft_consensus.cc:374] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:38:57.433323 18457 raft_consensus.cc:729] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc6f36ed88f74d6588b1214661fc0bed, State: Initialized, Role: FOLLOWER
I20260619 06:38:57.434388 18457 consensus_queue.cc:260] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } }
I20260619 06:38:57.439654 18457 ts_tablet_manager.cc:1428] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed: Time spent starting tablet: real 0.015s user 0.006s sys 0.008s
I20260619 06:38:57.441426 18455 ts_tablet_manager.cc:1428] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085: Time spent starting tablet: real 0.021s user 0.019s sys 0.000s
I20260619 06:38:57.441823 18421 heartbeater.cc:503] Master 127.10.192.126:33459 was elected leader, sending a full tablet report...
W20260619 06:38:57.473079 18423 tablet.cc:2369] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:38:57.482623 18460 raft_consensus.cc:482] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:38:57.482944 18460 raft_consensus.cc:504] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } }
I20260619 06:38:57.484625 18460 leader_election.cc:288] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40d10e23a819488ab3a62103a775c085 (127.10.192.67:35425), bc6f36ed88f74d6588b1214661fc0bed (127.10.192.65:42847)
W20260619 06:38:57.492440 18133 tablet.cc:2369] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:38:57.492928 18451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.485016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:41185 (local address 127.10.192.67:35425)
0619 06:38:57.485250 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:57.485259 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:57.485830 (+ 571us) server_negotiation.cc:407] Connection header received
0619 06:38:57.486063 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:57.486071 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:57.486178 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:57.486282 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:57.486898 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.488004 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.490601 (+ 2597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.491885 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.492088 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.492161 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:57.492528 (+ 367us) server_negotiation.cc:299] Negotiation successful
0619 06:38:57.492669 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260619 06:38:57.493081 18463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.485010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:35425 (local address 127.10.192.66:41185)
0619 06:38:57.485673 (+ 663us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:57.485690 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:57.485886 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:57.486328 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:57.486333 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:57.486366 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:57.486751 (+ 385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:57.486762 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.488134 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.488137 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:57.490426 (+ 2289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:57.490440 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.492157 (+ 1717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.492166 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:57.492339 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.492378 (+ 39us) client_negotiation.cc:769] Sending connection context
0619 06:38:57.492487 (+ 109us) client_negotiation.cc:240] Negotiation successful
0619 06:38:57.492628 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":560,"mutex_wait_us":1,"thread_start_us":389,"threads_started":1}
I20260619 06:38:57.493857 18464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.485829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:42847 (local address 127.10.192.66:55651)
0619 06:38:57.486493 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:57.486508 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:57.486637 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:57.486943 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:57.486946 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:57.486965 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:57.487196 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:57.487202 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.488430 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.488436 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:57.490450 (+ 2014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:57.490459 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.492841 (+ 2382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.492847 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:57.493355 (+ 508us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.493389 (+ 34us) client_negotiation.cc:769] Sending connection context
0619 06:38:57.493489 (+ 100us) client_negotiation.cc:240] Negotiation successful
0619 06:38:57.493635 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":345,"threads_started":1}
I20260619 06:38:57.493932 18453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.485977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:55651 (local address 127.10.192.65:42847)
0619 06:38:57.486165 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:57.486172 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:57.486605 (+ 433us) server_negotiation.cc:407] Connection header received
0619 06:38:57.486755 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:57.486758 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:57.486814 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:57.486927 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:57.487355 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.488304 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.490601 (+ 2297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.491885 (+ 1284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.492050 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.492122 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:57.493524 (+ 1402us) server_negotiation.cc:299] Negotiation successful
0619 06:38:57.493676 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260619 06:38:57.494169 18375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ef0050bb94a4c1ca924d3b51fe02435" candidate_uuid: "776283177ae340d790862761bc824aff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40d10e23a819488ab3a62103a775c085" is_pre_election: true
I20260619 06:38:57.494779 18375 raft_consensus.cc:2454] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 776283177ae340d790862761bc824aff in term 0.
I20260619 06:38:57.494901 18085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ef0050bb94a4c1ca924d3b51fe02435" candidate_uuid: "776283177ae340d790862761bc824aff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc6f36ed88f74d6588b1214661fc0bed" is_pre_election: true
I20260619 06:38:57.495375 18085 raft_consensus.cc:2454] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 776283177ae340d790862761bc824aff in term 0.
I20260619 06:38:57.495469 18168 leader_election.cc:302] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40d10e23a819488ab3a62103a775c085, 776283177ae340d790862761bc824aff; no voters:
I20260619 06:38:57.496292 18460 raft_consensus.cc:2781] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:38:57.496456 18460 raft_consensus.cc:482] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:38:57.496560 18460 raft_consensus.cc:3037] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:57.499703 18460 raft_consensus.cc:504] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } }
I20260619 06:38:57.500418 18460 leader_election.cc:288] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [CANDIDATE]: Term 1 election: Requested vote from peers 40d10e23a819488ab3a62103a775c085 (127.10.192.67:35425), bc6f36ed88f74d6588b1214661fc0bed (127.10.192.65:42847)
I20260619 06:38:57.500871 18375 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ef0050bb94a4c1ca924d3b51fe02435" candidate_uuid: "776283177ae340d790862761bc824aff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40d10e23a819488ab3a62103a775c085"
I20260619 06:38:57.500953 18085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ef0050bb94a4c1ca924d3b51fe02435" candidate_uuid: "776283177ae340d790862761bc824aff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc6f36ed88f74d6588b1214661fc0bed"
I20260619 06:38:57.501070 18375 raft_consensus.cc:3037] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:57.501197 18085 raft_consensus.cc:3037] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:38:57.503813 18085 raft_consensus.cc:2454] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 776283177ae340d790862761bc824aff in term 1.
I20260619 06:38:57.504235 18168 leader_election.cc:302] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 776283177ae340d790862761bc824aff, bc6f36ed88f74d6588b1214661fc0bed; no voters:
I20260619 06:38:57.504268 18375 raft_consensus.cc:2454] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 776283177ae340d790862761bc824aff in term 1.
I20260619 06:38:57.504554 18460 raft_consensus.cc:2781] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:38:57.505151 18460 raft_consensus.cc:686] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [term 1 LEADER]: Becoming Leader. State: Replica: 776283177ae340d790862761bc824aff, State: Running, Role: LEADER
I20260619 06:38:57.505826 18460 consensus_queue.cc:237] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } }
I20260619 06:38:57.511363 17160 catalog_manager.cc:5495] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff reported cstate change: term changed from 0 to 1, leader changed from <none> to 776283177ae340d790862761bc824aff (127.10.192.66). New cstate: current_term: 1 leader_uuid: "776283177ae340d790862761bc824aff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } health_report { overall_health: UNKNOWN } } }
I20260619 06:38:57.539036 18450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.533334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49440 (local address 127.10.192.66:41223)
0619 06:38:57.533515 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:57.533520 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:57.533538 (+ 18us) server_negotiation.cc:407] Connection header received
0619 06:38:57.533710 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:57.533713 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:57.533797 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:57.533920 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:38:57.534235 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.535062 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.536512 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.536955 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.537108 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.537754 (+ 646us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:38:57.538408 (+ 654us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:38:57.538523 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:57.538656 (+ 133us) server_negotiation.cc:299] Negotiation successful
0619 06:38:57.538722 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260619 06:38:57.547734 18085 raft_consensus.cc:1261] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed [term 1 FOLLOWER]: Refusing update from remote peer 776283177ae340d790862761bc824aff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:57.547775 18375 raft_consensus.cc:1261] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085 [term 1 FOLLOWER]: Refusing update from remote peer 776283177ae340d790862761bc824aff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:38:57.548727 18465 consensus_queue.cc:1035] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:57.549206 18460 consensus_queue.cc:1035] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [LEADER]: Connected to new peer: Peer: permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:38:57.565598 18468 mvcc.cc:205] Tried to move back new op lower bound from 7298462259385102336 to 7298462259228577792. Current Snapshot: MvccSnapshot[applied={T|T < 7298462259385102336}]
I20260619 06:38:57.565878 18470 mvcc.cc:205] Tried to move back new op lower bound from 7298462259385102336 to 7298462259228577792. Current Snapshot: MvccSnapshot[applied={T|T < 7298462259385102336}]
I20260619 06:38:57.589216 17159 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52340:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:38:57.589448 17159 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52340:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:38:57.597388 17159 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 54987b0b55b74c9585053e4148f4635a: Sending DeleteTablet for 3 replicas of tablet 5ef0050bb94a4c1ca924d3b51fe02435
I20260619 06:38:57.598521 18214 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ef0050bb94a4c1ca924d3b51fe02435 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:57 UTC) from {username='oryx', principal='oryx/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:49428
I20260619 06:38:57.599046 18065 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ef0050bb94a4c1ca924d3b51fe02435 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:57 UTC) from {username='oryx', principal='oryx/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:33512
I20260619 06:38:57.601189 18355 tablet_service.cc:1514] Processing DeleteTablet for tablet 5ef0050bb94a4c1ca924d3b51fe02435 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:38:57 UTC) from {username='oryx', principal='oryx/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:50206
I20260619 06:38:57.624958 18479 tablet_replica.cc:330] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed: stopping tablet replica
I20260619 06:38:57.625600 18480 tablet_replica.cc:330] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085: stopping tablet replica
I20260619 06:38:57.626264 18480 raft_consensus.cc:2229] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:57.626776 18478 tablet_replica.cc:330] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff: stopping tablet replica
I20260619 06:38:57.626919 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 17128
I20260619 06:38:57.627197 18478 raft_consensus.cc:2229] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:38:57.626964 18479 raft_consensus.cc:2229] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:38:57.628098 17190 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:38:57.628391 18478 raft_consensus.cc:2258] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:57.628964 18480 raft_consensus.cc:2258] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:57.629513 18479 raft_consensus.cc:2258] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:38:57.632124 18480 ts_tablet_manager.cc:1905] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:57.632330 18479 ts_tablet_manager.cc:1905] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:57.637948 18478 ts_tablet_manager.cc:1905] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:38:57.639945 18480 ts_tablet_manager.cc:1918] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:38:57.640136 18480 log.cc:1196] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/5ef0050bb94a4c1ca924d3b51fe02435
I20260619 06:38:57.640692 18480 ts_tablet_manager.cc:1939] T 5ef0050bb94a4c1ca924d3b51fe02435 P 40d10e23a819488ab3a62103a775c085: Deleting consensus metadata
I20260619 06:38:57.647071 18478 ts_tablet_manager.cc:1918] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:38:57.647305 18478 log.cc:1196] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/5ef0050bb94a4c1ca924d3b51fe02435
I20260619 06:38:57.647941 18478 ts_tablet_manager.cc:1939] T 5ef0050bb94a4c1ca924d3b51fe02435 P 776283177ae340d790862761bc824aff: Deleting consensus metadata
I20260619 06:38:57.651943 18479 ts_tablet_manager.cc:1918] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:38:57.652132 18479 log.cc:1196] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/5ef0050bb94a4c1ca924d3b51fe02435
I20260619 06:38:57.652840 18479 ts_tablet_manager.cc:1939] T 5ef0050bb94a4c1ca924d3b51fe02435 P bc6f36ed88f74d6588b1214661fc0bed: Deleting consensus metadata
I20260619 06:38:57.656860 18425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.602665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58304 (local address 127.10.192.125:37681)
0619 06:38:57.602876 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:57.602884 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:57.625352 (+ 22468us) server_negotiation.cc:407] Connection header received
0619 06:38:57.625722 (+ 370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:57.625728 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:57.625818 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:57.625922 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:57.633712 (+ 7790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.634995 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.640589 (+ 5594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.641274 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.641388 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.649621 (+ 8233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:57.649647 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:57.649652 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:57.649700 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:57.653321 (+ 3621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.654298 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.654305 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.654310 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.654488 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.655195 (+ 707us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.655201 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.655204 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.655580 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:57.655903 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:57.656281 (+ 378us) server_negotiation.cc:299] Negotiation successful
0619 06:38:57.656517 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 06:38:57.673355 18424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.626331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55682 (local address 127.10.192.124:35867)
0619 06:38:57.627517 (+ 1186us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:57.627524 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:57.657024 (+ 29500us) server_negotiation.cc:407] Connection header received
0619 06:38:57.657257 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:57.657264 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:57.657365 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:57.657440 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:57.659578 (+ 2138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.660751 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.662698 (+ 1947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.663315 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.663452 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.666722 (+ 3270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:57.666729 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:57.666734 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:57.666777 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:57.670382 (+ 3605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.671186 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.671192 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.671196 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.671353 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.671828 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.671833 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.671837 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.672194 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:57.672439 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:57.672768 (+ 329us) server_negotiation.cc:299] Negotiation successful
0619 06:38:57.672991 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1029}
I20260619 06:38:57.766806 17144 catalog_manager.cc:4841] TS 776283177ae340d790862761bc824aff (127.10.192.66:41223): tablet 5ef0050bb94a4c1ca924d3b51fe02435 (table test-table [id=1f09307742b945f69917b2e76e867843]) successfully deleted
I20260619 06:38:57.768370 17145 catalog_manager.cc:4841] TS bc6f36ed88f74d6588b1214661fc0bed (127.10.192.65:42847): tablet 5ef0050bb94a4c1ca924d3b51fe02435 (table test-table [id=1f09307742b945f69917b2e76e867843]) successfully deleted
I20260619 06:38:57.768682 17145 catalog_manager.cc:4841] TS 40d10e23a819488ab3a62103a775c085 (127.10.192.67:35425): tablet 5ef0050bb94a4c1ca924d3b51fe02435 (table test-table [id=1f09307742b945f69917b2e76e867843]) successfully deleted
I20260619 06:38:57.769155 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 17128
I20260619 06:38:57.839571 18424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.806067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55684 (local address 127.10.192.124:35867)
0619 06:38:57.806335 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:57.806344 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:57.807714 (+ 1370us) server_negotiation.cc:407] Connection header received
0619 06:38:57.811692 (+ 3978us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:57.811701 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:57.811811 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:57.811902 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:57.817888 (+ 5986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.819401 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.825763 (+ 6362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.826746 (+ 983us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.826881 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.832392 (+ 5511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:57.832398 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:57.832401 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:57.832444 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:57.835952 (+ 3508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.837219 (+ 1267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.837244 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.837250 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.837402 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.837947 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.837953 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.837956 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.838341 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:57.838596 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:57.838948 (+ 352us) server_negotiation.cc:299] Negotiation successful
0619 06:38:57.839140 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260619 06:38:57.840875 18425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:57.804880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58308 (local address 127.10.192.125:37681)
0619 06:38:57.805123 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:57.805133 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:57.807060 (+ 1927us) server_negotiation.cc:407] Connection header received
0619 06:38:57.808089 (+ 1029us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:57.808098 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:57.808217 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:57.808309 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:38:57.814945 (+ 6636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.816508 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.823393 (+ 6885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:57.824458 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:57.824598 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:57.833156 (+ 8558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:38:57.833165 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:38:57.833172 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:38:57.833218 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:38:57.836637 (+ 3419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.838682 (+ 2045us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.838688 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.838691 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.838849 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:38:57.839420 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:38:57.839426 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:38:57.839430 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:38:57.839832 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:38:57.840045 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:57.840430 (+ 385us) server_negotiation.cc:299] Negotiation successful
0619 06:38:57.840594 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260619 06:38:58.573736 18490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:58.572779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.65:40245)
0619 06:38:58.573353 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:58.573515 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":325,"threads_started":1}
W20260619 06:38:58.574154 18131 heartbeater.cc:644] Failed to heartbeat to 127.10.192.126:33459 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
I20260619 06:38:58.579605 18491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:58.578889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.67:60367)
0619 06:38:58.579308 (+ 419us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:58.579423 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":208,"threads_started":1}
W20260619 06:38:58.580071 18421 heartbeater.cc:644] Failed to heartbeat to 127.10.192.126:33459 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
I20260619 06:38:58.584992 18492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:58.584149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.66:50081)
0619 06:38:58.584678 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:58.584815 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":281,"threads_started":1}
W20260619 06:38:58.585341 18280 heartbeater.cc:644] Failed to heartbeat to 127.10.192.126:33459 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
I20260619 06:38:59.097287 18494 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54987b0b55b74c9585053e4148f4635a)
I20260619 06:38:59.097544 18493 raft_consensus.cc:482] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 54987b0b55b74c9585053e4148f4635a)
I20260619 06:38:59.097610 18494 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } }
I20260619 06:38:59.097790 18493 raft_consensus.cc:504] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } }
I20260619 06:38:59.099184 18494 leader_election.cc:288] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54987b0b55b74c9585053e4148f4635a (127.10.192.126:33459), 205072f35950483fbe0bcfdf30f66e62 (127.10.192.125:37681)
I20260619 06:38:59.099095 18493 leader_election.cc:288] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 54987b0b55b74c9585053e4148f4635a (127.10.192.126:33459), 9dbd17a454d34e55af9770b0e4565cf5 (127.10.192.124:35867)
I20260619 06:38:59.100652 18497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:59.099264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:52720)
0619 06:38:59.100009 (+ 745us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:59.100372 (+ 363us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":247,"threads_started":1}
W20260619 06:38:59.101011 17935 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
I20260619 06:38:59.101135 18495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:59.099265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:52716)
0619 06:38:59.100683 (+ 1418us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:59.100866 (+ 183us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1293,"thread_start_us":1155,"threads_started":1}
W20260619 06:38:59.103742 17746 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
I20260619 06:38:59.104110 18497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:59.103553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:52734)
0619 06:38:59.103810 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:59.103964 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":151}
W20260619 06:38:59.104390 17935 leader_election.cc:334] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 54987b0b55b74c9585053e4148f4635a (127.10.192.126:33459): Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
I20260619 06:38:59.106069 18495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:59.105711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:52742)
0619 06:38:59.105862 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:59.105958 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260619 06:38:59.106317 17746 leader_election.cc:334] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 54987b0b55b74c9585053e4148f4635a (127.10.192.126:33459): Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
I20260619 06:38:59.110001 18499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:59.101144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55692 (local address 127.10.192.124:35867)
0619 06:38:59.102365 (+ 1221us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:59.102374 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:59.102397 (+ 23us) server_negotiation.cc:407] Connection header received
0619 06:38:59.102480 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:59.102488 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:59.102581 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:59.103280 (+ 699us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:59.103513 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:59.104925 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:59.107393 (+ 2468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:59.108776 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:59.108929 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:59.109002 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:59.109635 (+ 633us) server_negotiation.cc:299] Negotiation successful
0619 06:38:59.109733 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":1068,"thread_start_us":1342,"threads_started":1}
I20260619 06:38:59.110250 18498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:59.100889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:35867 (local address 127.0.0.1:55692)
0619 06:38:59.101532 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:59.101556 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:59.101702 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:59.102786 (+ 1084us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:59.102792 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:59.102818 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:59.103154 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:59.103163 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:59.105112 (+ 1949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:59.105118 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:59.107234 (+ 2116us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:59.107245 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:59.108988 (+ 1743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:59.108995 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:59.109327 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:59.109460 (+ 133us) client_negotiation.cc:769] Sending connection context
0619 06:38:59.109614 (+ 154us) client_negotiation.cc:240] Negotiation successful
0619 06:38:59.109774 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"mutex_wait_us":163,"thread_start_us":389,"threads_started":1}
I20260619 06:38:59.111102 17961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "205072f35950483fbe0bcfdf30f66e62" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "9dbd17a454d34e55af9770b0e4565cf5" is_pre_election: true
I20260619 06:38:59.111455 18496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:59.099310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:37681 (local address 127.0.0.1:58324)
0619 06:38:59.100404 (+ 1094us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:59.100425 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 06:38:59.100583 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:38:59.104327 (+ 3744us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:38:59.104335 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:38:59.104371 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:38:59.104938 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:59.104950 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:59.106722 (+ 1772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:59.106726 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:59.108755 (+ 2029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:38:59.108771 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:38:59.110678 (+ 1907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:38:59.110685 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:38:59.110869 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:59.110902 (+ 33us) client_negotiation.cc:769] Sending connection context
0619 06:38:59.110980 (+ 78us) client_negotiation.cc:240] Negotiation successful
0619 06:38:59.111071 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":957,"mutex_wait_us":48,"thread_start_us":814,"threads_started":1}
I20260619 06:38:59.111552 18501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:59.101526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58324 (local address 127.10.192.125:37681)
0619 06:38:59.103776 (+ 2250us) server_negotiation.cc:206] Beginning negotiation
0619 06:38:59.103783 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:38:59.103800 (+ 17us) server_negotiation.cc:407] Connection header received
0619 06:38:59.103873 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:38:59.103878 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:38:59.103944 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:38:59.104044 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:38:59.105097 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:59.106595 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:59.108963 (+ 2368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:38:59.110500 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:38:59.110674 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:38:59.110727 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0619 06:38:59.111038 (+ 311us) server_negotiation.cc:299] Negotiation successful
0619 06:38:59.111188 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":2123,"thread_start_us":1933,"threads_started":1}
I20260619 06:38:59.111613 17961 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 205072f35950483fbe0bcfdf30f66e62 in term 1.
I20260619 06:38:59.112210 17746 leader_election.cc:302] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 205072f35950483fbe0bcfdf30f66e62, 9dbd17a454d34e55af9770b0e4565cf5; no voters: 54987b0b55b74c9585053e4148f4635a
I20260619 06:38:59.112231 17772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9dbd17a454d34e55af9770b0e4565cf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "205072f35950483fbe0bcfdf30f66e62" is_pre_election: true
I20260619 06:38:59.112589 17772 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dbd17a454d34e55af9770b0e4565cf5 in term 1.
I20260619 06:38:59.112788 18493 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 06:38:59.112967 18493 raft_consensus.cc:482] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54987b0b55b74c9585053e4148f4635a)
I20260619 06:38:59.113075 18493 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 1 FOLLOWER]: Advancing to term 2
I20260619 06:38:59.113129 17937 leader_election.cc:302] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 205072f35950483fbe0bcfdf30f66e62, 9dbd17a454d34e55af9770b0e4565cf5; no voters: 54987b0b55b74c9585053e4148f4635a
I20260619 06:38:59.113564 18494 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260619 06:38:59.113687 18494 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 54987b0b55b74c9585053e4148f4635a)
I20260619 06:38:59.113801 18494 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 1 FOLLOWER]: Advancing to term 2
I20260619 06:38:59.116395 18493 raft_consensus.cc:504] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } }
I20260619 06:38:59.116952 18494 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } }
I20260619 06:38:59.117224 18493 leader_election.cc:288] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [CANDIDATE]: Term 2 election: Requested vote from peers 54987b0b55b74c9585053e4148f4635a (127.10.192.126:33459), 9dbd17a454d34e55af9770b0e4565cf5 (127.10.192.124:35867)
I20260619 06:38:59.117733 18494 leader_election.cc:288] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [CANDIDATE]: Term 2 election: Requested vote from peers 54987b0b55b74c9585053e4148f4635a (127.10.192.126:33459), 205072f35950483fbe0bcfdf30f66e62 (127.10.192.125:37681)
I20260619 06:38:59.117781 18498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:59.117381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:52754)
0619 06:38:59.117553 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:59.117644 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260619 06:38:59.118117 17961 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "205072f35950483fbe0bcfdf30f66e62" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "9dbd17a454d34e55af9770b0e4565cf5"
I20260619 06:38:59.118428 17961 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 205072f35950483fbe0bcfdf30f66e62 in current term 2: Already voted for candidate 9dbd17a454d34e55af9770b0e4565cf5 in this term.
I20260619 06:38:59.118425 17772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9dbd17a454d34e55af9770b0e4565cf5" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "205072f35950483fbe0bcfdf30f66e62"
I20260619 06:38:59.118726 17772 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9dbd17a454d34e55af9770b0e4565cf5 in current term 2: Already voted for candidate 205072f35950483fbe0bcfdf30f66e62 in this term.
I20260619 06:38:59.118949 18498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:59.118509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:52774)
0619 06:38:59.118681 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:59.118792 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260619 06:38:59.118963 18496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:59.117831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:52758)
0619 06:38:59.118737 (+ 906us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:59.118826 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":804}
W20260619 06:38:59.119282 17746 leader_election.cc:334] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 54987b0b55b74c9585053e4148f4635a (127.10.192.126:33459): Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
I20260619 06:38:59.119482 17746 leader_election.cc:302] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 205072f35950483fbe0bcfdf30f66e62; no voters: 54987b0b55b74c9585053e4148f4635a, 9dbd17a454d34e55af9770b0e4565cf5
I20260619 06:38:59.119772 18493 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260619 06:38:59.120014 18496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:59.119576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:52786)
0619 06:38:59.119745 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:59.119865 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
W20260619 06:38:59.120210 17935 leader_election.cc:334] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 54987b0b55b74c9585053e4148f4635a (127.10.192.126:33459): Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
I20260619 06:38:59.120324 17935 leader_election.cc:302] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9dbd17a454d34e55af9770b0e4565cf5; no voters: 205072f35950483fbe0bcfdf30f66e62, 54987b0b55b74c9585053e4148f4635a
I20260619 06:38:59.120680 18494 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260619 06:38:59.576009 18503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:59.574987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.65:38391)
0619 06:38:59.575552 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:59.575701 (+ 149us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":316,"threads_started":1}
I20260619 06:38:59.581547 18504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:59.580865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.67:43849)
0619 06:38:59.581308 (+ 443us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:59.581399 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":345,"thread_start_us":233,"threads_started":1}
I20260619 06:38:59.586637 18505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:38:59.585953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.66:32909)
0619 06:38:59.586331 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0619 06:38:59.586464 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":286,"thread_start_us":196,"threads_started":1}
I20260619 06:39:00.577898 18506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:00.576997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.65:41705)
0619 06:39:00.577491 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:00.577629 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":298,"threads_started":1}
I20260619 06:39:00.583252 18507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:00.582542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.67:46655)
0619 06:39:00.582995 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:00.583080 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":254,"threads_started":1}
I20260619 06:39:00.588303 18508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:00.587505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.66:43015)
0619 06:39:00.588014 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:00.588105 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":283,"threads_started":1}
I20260619 06:39:01.147428 18509 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:39:01.147624 18509 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } }
I20260619 06:39:01.148362 18509 leader_election.cc:288] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 54987b0b55b74c9585053e4148f4635a (127.10.192.126:33459), 205072f35950483fbe0bcfdf30f66e62 (127.10.192.125:37681)
I20260619 06:39:01.148898 17772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9dbd17a454d34e55af9770b0e4565cf5" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "205072f35950483fbe0bcfdf30f66e62" is_pre_election: true
I20260619 06:39:01.149169 17772 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9dbd17a454d34e55af9770b0e4565cf5 in term 2.
I20260619 06:39:01.149662 17937 leader_election.cc:302] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 205072f35950483fbe0bcfdf30f66e62, 9dbd17a454d34e55af9770b0e4565cf5; no voters:
I20260619 06:39:01.149886 18510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.148611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:53094)
0619 06:39:01.149456 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.149619 (+ 163us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":700,"thread_start_us":574,"threads_started":1}
I20260619 06:39:01.149998 18509 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260619 06:39:01.150100 18509 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:39:01.150261 18509 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 2 FOLLOWER]: Advancing to term 3
I20260619 06:39:01.152411 18509 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } }
I20260619 06:39:01.153225 18509 leader_election.cc:288] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [CANDIDATE]: Term 3 election: Requested vote from peers 54987b0b55b74c9585053e4148f4635a (127.10.192.126:33459), 205072f35950483fbe0bcfdf30f66e62 (127.10.192.125:37681)
I20260619 06:39:01.153712 18510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.153269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:53108)
0619 06:39:01.153479 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.153572 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
I20260619 06:39:01.153697 17772 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9dbd17a454d34e55af9770b0e4565cf5" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "205072f35950483fbe0bcfdf30f66e62"
I20260619 06:39:01.153895 17772 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 2 FOLLOWER]: Advancing to term 3
W20260619 06:39:01.153898 17935 leader_election.cc:334] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 54987b0b55b74c9585053e4148f4635a (127.10.192.126:33459): Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
I20260619 06:39:01.154974 18510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.154590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:53124)
0619 06:39:01.154738 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.154833 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260619 06:39:01.155140 17935 leader_election.cc:334] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 54987b0b55b74c9585053e4148f4635a (127.10.192.126:33459): Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
I20260619 06:39:01.156347 17772 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9dbd17a454d34e55af9770b0e4565cf5 in term 3.
I20260619 06:39:01.156746 17937 leader_election.cc:302] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 205072f35950483fbe0bcfdf30f66e62, 9dbd17a454d34e55af9770b0e4565cf5; no voters: 54987b0b55b74c9585053e4148f4635a
I20260619 06:39:01.157032 18509 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 3 FOLLOWER]: Leader election won for term 3
I20260619 06:39:01.157436 18509 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [term 3 LEADER]: Becoming Leader. State: Replica: 9dbd17a454d34e55af9770b0e4565cf5, State: Running, Role: LEADER
I20260619 06:39:01.157804 18509 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } }
I20260619 06:39:01.159621 18512 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9dbd17a454d34e55af9770b0e4565cf5. Latest consensus state: current_term: 3 leader_uuid: "9dbd17a454d34e55af9770b0e4565cf5" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } } }
I20260619 06:39:01.160007 18512 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [sys.catalog]: This master's current role is: LEADER
I20260619 06:39:01.160610 18514 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:39:01.164033 18514 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:39:01.164855 18514 catalog_manager.cc:1259] Loaded cluster ID: e0d8d3da0d5e4194a70beb96d7c6ec54
I20260619 06:39:01.164930 18514 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:39:01.166218 18514 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:39:01.167176 18514 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: Loaded TSK: 0
I20260619 06:39:01.168107 18514 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:39:01.210887 17951 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55684:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:39:01.217880 17951 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:39:01.222389 18510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.221900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:53130)
0619 06:39:01.222102 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.222217 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260619 06:39:01.222484 17772 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [term 3 FOLLOWER]: Refusing update from remote peer 9dbd17a454d34e55af9770b0e4565cf5: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260619 06:39:01.223218 18509 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260619 06:39:01.223570 18510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.223127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:53146)
0619 06:39:01.223302 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.223390 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94}
W20260619 06:39:01.223856 17935 consensus_peers.cc:487] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 -> Peer 54987b0b55b74c9585053e4148f4635a (127.10.192.126:33459): Couldn't send request to peer 54987b0b55b74c9585053e4148f4635a. Status: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260619 06:39:01.226178 18516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9dbd17a454d34e55af9770b0e4565cf5. Latest consensus state: current_term: 3 leader_uuid: "9dbd17a454d34e55af9770b0e4565cf5" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } } }
I20260619 06:39:01.226506 18516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:39:01.227968 18509 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "9dbd17a454d34e55af9770b0e4565cf5" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } } }
I20260619 06:39:01.228339 18509 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5 [sys.catalog]: This master's current role is: LEADER
I20260619 06:39:01.228765 18516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "9dbd17a454d34e55af9770b0e4565cf5" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "54987b0b55b74c9585053e4148f4635a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33459 } } peers { permanent_uuid: "205072f35950483fbe0bcfdf30f66e62" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 37681 } attrs { promote: false } } peers { permanent_uuid: "9dbd17a454d34e55af9770b0e4565cf5" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 35867 } attrs { promote: false } } }
I20260619 06:39:01.228976 18516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 205072f35950483fbe0bcfdf30f66e62 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:39:01.254922 18525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.245170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50216 (local address 127.10.192.67:35425)
0619 06:39:01.246037 (+ 867us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:01.246048 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:01.247077 (+ 1029us) server_negotiation.cc:407] Connection header received
0619 06:39:01.247413 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:01.247422 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:01.247534 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:01.247695 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:39:01.248494 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.249732 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.252621 (+ 2889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.253830 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.253948 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:01.254070 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:01.254431 (+ 361us) server_negotiation.cc:299] Negotiation successful
0619 06:39:01.254596 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":795,"threads_started":1}
I20260619 06:39:01.256292 18510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.237081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:41223 (local address 127.0.0.1:49450)
0619 06:39:01.237255 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.237278 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:01.237423 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:01.249905 (+ 12482us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:01.249913 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:01.249958 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:39:01.250270 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:01.250279 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.251613 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.251620 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:01.253715 (+ 2095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:01.253730 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.255733 (+ 2003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.255739 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:01.255930 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:01.255953 (+ 23us) client_negotiation.cc:769] Sending connection context
0619 06:39:01.256027 (+ 74us) client_negotiation.cc:240] Negotiation successful
0619 06:39:01.256113 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260619 06:39:01.254978 18526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.246224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:35425 (local address 127.0.0.1:50216)
0619 06:39:01.246960 (+ 736us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.246984 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:01.247195 (+ 211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:01.247735 (+ 540us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:01.247743 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:01.247779 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:39:01.248262 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:01.248277 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.250303 (+ 2026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.250308 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:01.252384 (+ 2076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:01.252398 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.254011 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.254020 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:01.254209 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:01.254249 (+ 40us) client_negotiation.cc:769] Sending connection context
0619 06:39:01.254376 (+ 127us) client_negotiation.cc:240] Negotiation successful
0619 06:39:01.254527 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":358,"threads_started":1}
I20260619 06:39:01.256680 18524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.238247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49450 (local address 127.10.192.66:41223)
0619 06:39:01.249547 (+ 11300us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:01.249552 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:01.249571 (+ 19us) server_negotiation.cc:407] Connection header received
0619 06:39:01.249634 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:01.249640 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:01.249716 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:01.249832 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:39:01.250439 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.251487 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.253944 (+ 2457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.255484 (+ 1540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.255615 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:01.255748 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:01.256076 (+ 328us) server_negotiation.cc:299] Negotiation successful
0619 06:39:01.256225 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11184,"thread_start_us":11059,"threads_started":1}
I20260619 06:39:01.257438 18214 tablet_service.cc:1467] Processing CreateTablet for tablet d73755d131da41859564925ba734b5b2 (DEFAULT_TABLE table=test-table [id=0fa4a77eabf047b0923b64f88dced833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:39:01.257531 18355 tablet_service.cc:1467] Processing CreateTablet for tablet d73755d131da41859564925ba734b5b2 (DEFAULT_TABLE table=test-table [id=0fa4a77eabf047b0923b64f88dced833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:39:01.257918 18355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d73755d131da41859564925ba734b5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:01.257918 18214 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d73755d131da41859564925ba734b5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:01.258704 18523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.238187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33524 (local address 127.10.192.65:42847)
0619 06:39:01.250282 (+ 12095us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:01.250288 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:01.250304 (+ 16us) server_negotiation.cc:407] Connection header received
0619 06:39:01.250368 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:01.250523 (+ 155us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:01.250609 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:01.250713 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:39:01.251409 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.252498 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.256597 (+ 4099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.257724 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.257885 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:01.257991 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:01.258277 (+ 286us) server_negotiation.cc:299] Negotiation successful
0619 06:39:01.258422 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11969,"thread_start_us":11876,"threads_started":1}
I20260619 06:39:01.258731 18522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.237748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:42847 (local address 127.0.0.1:33524)
0619 06:39:01.244910 (+ 7162us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.244956 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:01.245119 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:01.250750 (+ 5631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:01.250754 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:01.250780 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:39:01.251199 (+ 419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:01.251211 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.254075 (+ 2864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.254082 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:01.256259 (+ 2177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:01.256271 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.257945 (+ 1674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.257950 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:01.258128 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:01.258149 (+ 21us) client_negotiation.cc:769] Sending connection context
0619 06:39:01.258249 (+ 100us) client_negotiation.cc:240] Negotiation successful
0619 06:39:01.258371 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6970,"mutex_wait_us":2,"thread_start_us":6802,"threads_started":1}
I20260619 06:39:01.259884 18065 tablet_service.cc:1467] Processing CreateTablet for tablet d73755d131da41859564925ba734b5b2 (DEFAULT_TABLE table=test-table [id=0fa4a77eabf047b0923b64f88dced833]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:39:01.260335 18065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d73755d131da41859564925ba734b5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:01.265419 18528 tablet_bootstrap.cc:492] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff: Bootstrap starting.
I20260619 06:39:01.266198 18527 tablet_bootstrap.cc:492] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085: Bootstrap starting.
I20260619 06:39:01.267681 18527 tablet_bootstrap.cc:654] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:01.267997 18529 tablet_bootstrap.cc:492] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed: Bootstrap starting.
I20260619 06:39:01.269759 18529 tablet_bootstrap.cc:654] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:01.270022 18527 tablet_bootstrap.cc:492] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085: No bootstrap required, opened a new log
I20260619 06:39:01.270179 18527 ts_tablet_manager.cc:1397] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260619 06:39:01.270735 18528 tablet_bootstrap.cc:654] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:01.271116 18527 raft_consensus.cc:348] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } }
I20260619 06:39:01.271425 18527 raft_consensus.cc:374] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:01.271550 18527 raft_consensus.cc:729] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40d10e23a819488ab3a62103a775c085, State: Initialized, Role: FOLLOWER
I20260619 06:39:01.271878 18527 consensus_queue.cc:260] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } }
I20260619 06:39:01.272907 18527 ts_tablet_manager.cc:1428] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260619 06:39:01.275679 18534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.273652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.67:53209)
0619 06:39:01.274394 (+ 742us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.274598 (+ 204us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":536,"threads_started":1}
I20260619 06:39:01.277565 18534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.277080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.67:60001)
0619 06:39:01.277320 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.277406 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260619 06:39:01.278110 18529 tablet_bootstrap.cc:492] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed: No bootstrap required, opened a new log
I20260619 06:39:01.278271 18529 ts_tablet_manager.cc:1397] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.005s
I20260619 06:39:01.279125 18529 raft_consensus.cc:348] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } }
I20260619 06:39:01.279353 18529 raft_consensus.cc:374] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:01.279453 18529 raft_consensus.cc:729] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc6f36ed88f74d6588b1214661fc0bed, State: Initialized, Role: FOLLOWER
I20260619 06:39:01.279793 18529 consensus_queue.cc:260] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } }
I20260619 06:39:01.280046 18420 heartbeater.cc:503] Master 127.10.192.124:35867 was elected leader, sending a full tablet report...
I20260619 06:39:01.280633 18529 ts_tablet_manager.cc:1428] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260619 06:39:01.281114 18528 tablet_bootstrap.cc:492] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff: No bootstrap required, opened a new log
I20260619 06:39:01.281280 18528 ts_tablet_manager.cc:1397] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.010s
I20260619 06:39:01.282148 18528 raft_consensus.cc:348] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } }
I20260619 06:39:01.282351 18528 raft_consensus.cc:374] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:01.282455 18528 raft_consensus.cc:729] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 776283177ae340d790862761bc824aff, State: Initialized, Role: FOLLOWER
I20260619 06:39:01.282680 18528 consensus_queue.cc:260] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } }
I20260619 06:39:01.283525 18528 ts_tablet_manager.cc:1428] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260619 06:39:01.285820 18538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.283931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.66:55995)
0619 06:39:01.284466 (+ 535us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.285532 (+ 1066us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":271,"threads_started":1}
I20260619 06:39:01.285899 18279 heartbeater.cc:503] Master 127.10.192.124:35867 was elected leader, sending a full tablet report...
I20260619 06:39:01.286835 18538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.286425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.66:40187)
0619 06:39:01.286608 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.286698 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260619 06:39:01.295791 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.281253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.65:34395)
0619 06:39:01.295364 (+ 14111us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.295499 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13987,"threads_started":1}
I20260619 06:39:01.296931 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.296591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.65:35591)
0619 06:39:01.296749 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.296828 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260619 06:39:01.297569 18130 heartbeater.cc:503] Master 127.10.192.124:35867 was elected leader, sending a full tablet report...
W20260619 06:39:01.353645 18282 tablet.cc:2369] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:39:01.391074 18533 raft_consensus.cc:482] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:39:01.391434 18533 raft_consensus.cc:504] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } }
I20260619 06:39:01.393144 18533 leader_election.cc:288] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 776283177ae340d790862761bc824aff (127.10.192.66:41223), bc6f36ed88f74d6588b1214661fc0bed (127.10.192.65:42847)
I20260619 06:39:01.399516 18534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.393399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:41223 (local address 127.10.192.67:60813)
0619 06:39:01.393806 (+ 407us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.393828 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:01.394011 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:01.394571 (+ 560us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:01.394576 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:01.394619 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:39:01.394903 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:01.394916 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.396066 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.396071 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:01.397576 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:01.397587 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.398757 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.398766 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:01.398969 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:01.398996 (+ 27us) client_negotiation.cc:769] Sending connection context
0619 06:39:01.399071 (+ 75us) client_negotiation.cc:240] Negotiation successful
0619 06:39:01.399214 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":277}
I20260619 06:39:01.399593 18523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.393562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:34909 (local address 127.10.192.65:42847)
0619 06:39:01.393773 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:01.393777 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:01.394577 (+ 800us) server_negotiation.cc:407] Connection header received
0619 06:39:01.394655 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:01.394660 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:01.394750 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:01.394847 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:39:01.395410 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.396259 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.397892 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.398680 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.398835 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:01.398905 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:01.399214 (+ 309us) server_negotiation.cc:299] Negotiation successful
0619 06:39:01.399351 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260619 06:39:01.399662 18539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.393562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:42847 (local address 127.10.192.67:34909)
0619 06:39:01.394344 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.394362 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:01.394500 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:01.394875 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:01.394881 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:01.394900 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:39:01.395235 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:01.395245 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.396400 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.396404 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:01.397742 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:01.397755 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.398879 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.398883 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:01.399024 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:01.399072 (+ 48us) client_negotiation.cc:769] Sending connection context
0619 06:39:01.399164 (+ 92us) client_negotiation.cc:240] Negotiation successful
0619 06:39:01.399280 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"thread_start_us":411,"threads_started":1}
I20260619 06:39:01.399536 18524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.393447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:60813 (local address 127.10.192.66:41223)
0619 06:39:01.393693 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:01.393700 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:01.393932 (+ 232us) server_negotiation.cc:407] Connection header received
0619 06:39:01.394207 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:01.394214 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:01.394297 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:01.394413 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:39:01.395069 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.395933 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.397735 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.398573 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.398697 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:01.398789 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:01.399127 (+ 338us) server_negotiation.cc:299] Negotiation successful
0619 06:39:01.399271 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260619 06:39:01.400341 18085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d73755d131da41859564925ba734b5b2" candidate_uuid: "40d10e23a819488ab3a62103a775c085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc6f36ed88f74d6588b1214661fc0bed" is_pre_election: true
I20260619 06:39:01.400591 18085 raft_consensus.cc:2454] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40d10e23a819488ab3a62103a775c085 in term 0.
I20260619 06:39:01.400779 18234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d73755d131da41859564925ba734b5b2" candidate_uuid: "40d10e23a819488ab3a62103a775c085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "776283177ae340d790862761bc824aff" is_pre_election: true
I20260619 06:39:01.401149 18309 leader_election.cc:302] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40d10e23a819488ab3a62103a775c085, bc6f36ed88f74d6588b1214661fc0bed; no voters:
I20260619 06:39:01.401226 18234 raft_consensus.cc:2454] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40d10e23a819488ab3a62103a775c085 in term 0.
I20260619 06:39:01.401521 18533 raft_consensus.cc:2781] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:39:01.401691 18533 raft_consensus.cc:482] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:39:01.401815 18533 raft_consensus.cc:3037] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:01.404026 18533 raft_consensus.cc:504] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } }
I20260619 06:39:01.404620 18533 leader_election.cc:288] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [CANDIDATE]: Term 1 election: Requested vote from peers 776283177ae340d790862761bc824aff (127.10.192.66:41223), bc6f36ed88f74d6588b1214661fc0bed (127.10.192.65:42847)
I20260619 06:39:01.405005 18234 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d73755d131da41859564925ba734b5b2" candidate_uuid: "40d10e23a819488ab3a62103a775c085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "776283177ae340d790862761bc824aff"
I20260619 06:39:01.405228 18234 raft_consensus.cc:3037] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:01.405228 18085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d73755d131da41859564925ba734b5b2" candidate_uuid: "40d10e23a819488ab3a62103a775c085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc6f36ed88f74d6588b1214661fc0bed"
I20260619 06:39:01.405433 18085 raft_consensus.cc:3037] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:01.408377 18085 raft_consensus.cc:2454] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d10e23a819488ab3a62103a775c085 in term 1.
I20260619 06:39:01.408372 18234 raft_consensus.cc:2454] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40d10e23a819488ab3a62103a775c085 in term 1.
I20260619 06:39:01.408877 18309 leader_election.cc:302] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 40d10e23a819488ab3a62103a775c085, 776283177ae340d790862761bc824aff, bc6f36ed88f74d6588b1214661fc0bed; no voters:
I20260619 06:39:01.409238 18533 raft_consensus.cc:2781] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:39:01.409705 18533 raft_consensus.cc:686] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [term 1 LEADER]: Becoming Leader. State: Replica: 40d10e23a819488ab3a62103a775c085, State: Running, Role: LEADER
I20260619 06:39:01.410109 18533 consensus_queue.cc:237] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } }
I20260619 06:39:01.410807 18539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.410328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.67:42409)
0619 06:39:01.410508 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.410641 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260619 06:39:01.413720 17951 catalog_manager.cc:5495] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40d10e23a819488ab3a62103a775c085 (127.10.192.67). New cstate: current_term: 1 leader_uuid: "40d10e23a819488ab3a62103a775c085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40d10e23a819488ab3a62103a775c085" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 35425 } health_report { overall_health: HEALTHY } } }
I20260619 06:39:01.455731 18525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.450364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50222 (local address 127.10.192.67:35425)
0619 06:39:01.450582 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:01.450590 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:01.450611 (+ 21us) server_negotiation.cc:407] Connection header received
0619 06:39:01.450878 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:01.450883 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:01.450960 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:01.451115 (+ 155us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:39:01.451476 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.452244 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.453523 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.453933 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.454069 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:01.454486 (+ 417us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:39:01.455075 (+ 589us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:39:01.455242 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:01.455322 (+ 80us) server_negotiation.cc:299] Negotiation successful
0619 06:39:01.455410 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260619 06:39:01.459872 18085 raft_consensus.cc:1261] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed [term 1 FOLLOWER]: Refusing update from remote peer 40d10e23a819488ab3a62103a775c085: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:39:01.460289 18234 raft_consensus.cc:1261] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff [term 1 FOLLOWER]: Refusing update from remote peer 40d10e23a819488ab3a62103a775c085: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:39:01.460618 18540 consensus_queue.cc:1035] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc6f36ed88f74d6588b1214661fc0bed" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42847 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:39:01.461110 18533 consensus_queue.cc:1035] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "776283177ae340d790862761bc824aff" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 41223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:39:01.463303 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.462788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.65:57027)
0619 06:39:01.462957 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.463090 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260619 06:39:01.466941 18538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.463679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.66:58403)
0619 06:39:01.466345 (+ 2666us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.466727 (+ 382us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2562}
I20260619 06:39:01.469645 18538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.469134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.66:58187)
0619 06:39:01.469321 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.469436 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260619 06:39:01.472925 18539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.472486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.67:59035)
0619 06:39:01.472633 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.472746 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260619 06:39:01.480046 18544 mvcc.cc:205] Tried to move back new op lower bound from 7298462275412262912 to 7298462275220635648. Current Snapshot: MvccSnapshot[applied={T|T < 7298462275412262912}]
I20260619 06:39:01.481120 18536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.480466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.65:37761)
0619 06:39:01.480838 (+ 372us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.480939 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":235}
I20260619 06:39:01.483242 18539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.481641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.10.192.67:48811)
0619 06:39:01.482931 (+ 1290us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.483038 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":560}
I20260619 06:39:01.489825 17951 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:39:01.490142 17951 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55684:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:39:01.497288 17951 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9dbd17a454d34e55af9770b0e4565cf5: Sending DeleteTablet for 3 replicas of tablet d73755d131da41859564925ba734b5b2
I20260619 06:39:01.498414 18214 tablet_service.cc:1514] Processing DeleteTablet for tablet d73755d131da41859564925ba734b5b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:01 UTC) from {username='oryx', principal='oryx/127.10.192.124@KRBTEST.COM'} at 127.0.0.1:49450
I20260619 06:39:01.499150 18064 tablet_service.cc:1514] Processing DeleteTablet for tablet d73755d131da41859564925ba734b5b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:01 UTC) from {username='oryx', principal='oryx/127.10.192.124@KRBTEST.COM'} at 127.0.0.1:33524
I20260619 06:39:01.499835 18065 tablet_service.cc:1514] Processing DeleteTablet for tablet d73755d131da41859564925ba734b5b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:01 UTC) from {username='oryx', principal='oryx/127.10.192.124@KRBTEST.COM'} at 127.0.0.1:33524
I20260619 06:39:01.500202 18355 tablet_service.cc:1514] Processing DeleteTablet for tablet d73755d131da41859564925ba734b5b2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:01 UTC) from {username='oryx', principal='oryx/127.10.192.124@KRBTEST.COM'} at 127.0.0.1:50216
I20260619 06:39:01.500816 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 17987
I20260619 06:39:01.509265 18554 tablet_replica.cc:330] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed: stopping tablet replica
I20260619 06:39:01.509558 18554 raft_consensus.cc:2229] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:39:01.509928 18554 raft_consensus.cc:2258] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:39:01.512612 18554 ts_tablet_manager.cc:1905] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:39:01.513356 18555 tablet_replica.cc:330] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085: stopping tablet replica
I20260619 06:39:01.513556 18555 raft_consensus.cc:2229] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:39:01.514189 18555 raft_consensus.cc:2258] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:39:01.515420 18555 ts_tablet_manager.cc:1905] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:39:01.519251 18554 ts_tablet_manager.cc:1918] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:39:01.519392 18554 log.cc:1196] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/d73755d131da41859564925ba734b5b2
I20260619 06:39:01.525797 18554 ts_tablet_manager.cc:1939] T d73755d131da41859564925ba734b5b2 P bc6f36ed88f74d6588b1214661fc0bed: Deleting consensus metadata
I20260619 06:39:01.527252 17936 catalog_manager.cc:4841] TS bc6f36ed88f74d6588b1214661fc0bed (127.10.192.65:42847): tablet d73755d131da41859564925ba734b5b2 (table test-table [id=0fa4a77eabf047b0923b64f88dced833]) successfully deleted
W20260619 06:39:01.527745 17936 catalog_manager.cc:4808] TS bc6f36ed88f74d6588b1214661fc0bed (127.10.192.65:42847): delete failed for tablet d73755d131da41859564925ba734b5b2 because the tablet was not found. No further retry: Not found: Tablet not found: d73755d131da41859564925ba734b5b2
I20260619 06:39:01.529251 18553 tablet_replica.cc:330] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff: stopping tablet replica
I20260619 06:39:01.529453 18553 raft_consensus.cc:2229] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:39:01.529758 18553 raft_consensus.cc:2258] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:39:01.531785 18555 ts_tablet_manager.cc:1918] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:39:01.531965 18555 log.cc:1196] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/d73755d131da41859564925ba734b5b2
I20260619 06:39:01.532512 18555 ts_tablet_manager.cc:1939] T d73755d131da41859564925ba734b5b2 P 40d10e23a819488ab3a62103a775c085: Deleting consensus metadata
I20260619 06:39:01.533002 18553 ts_tablet_manager.cc:1905] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:39:01.533928 17936 catalog_manager.cc:4841] TS 40d10e23a819488ab3a62103a775c085 (127.10.192.67:35425): tablet d73755d131da41859564925ba734b5b2 (table test-table [id=0fa4a77eabf047b0923b64f88dced833]) successfully deleted
I20260619 06:39:01.540014 18553 ts_tablet_manager.cc:1918] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:39:01.540239 18553 log.cc:1196] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/d73755d131da41859564925ba734b5b2
I20260619 06:39:01.540634 18523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.501974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33530 (local address 127.10.192.65:42847)
0619 06:39:01.502190 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:01.502199 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:01.522233 (+ 20034us) server_negotiation.cc:407] Connection header received
0619 06:39:01.522552 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:01.522561 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:01.522668 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:01.522755 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:01.525650 (+ 2895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.526796 (+ 1146us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.529098 (+ 2302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.529680 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.529811 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:01.533496 (+ 3685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:01.533513 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:01.533532 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:01.533573 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:01.537225 (+ 3652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:01.538135 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:01.538146 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:01.538149 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:01.538291 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:01.538679 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:01.538685 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:01.538688 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:01.539057 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:01.539356 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:01.539992 (+ 636us) server_negotiation.cc:299] Negotiation successful
0619 06:39:01.540223 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 06:39:01.540746 18553 ts_tablet_manager.cc:1939] T d73755d131da41859564925ba734b5b2 P 776283177ae340d790862761bc824aff: Deleting consensus metadata
I20260619 06:39:01.541297 18125 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:01.541893 17935 catalog_manager.cc:4841] TS 776283177ae340d790862761bc824aff (127.10.192.66:41223): tablet d73755d131da41859564925ba734b5b2 (table test-table [id=0fa4a77eabf047b0923b64f88dced833]) successfully deleted
I20260619 06:39:01.654069 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 17987
I20260619 06:39:01.677619 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 18142
I20260619 06:39:01.692724 18524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.678554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49466 (local address 127.10.192.66:41223)
0619 06:39:01.678737 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:01.678743 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:01.678764 (+ 21us) server_negotiation.cc:407] Connection header received
0619 06:39:01.678986 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:01.678995 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:01.679059 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:01.679172 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:01.680577 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.681300 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.682533 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.682929 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.683067 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:01.686473 (+ 3406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:01.686490 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:01.686506 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:01.686548 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:01.689586 (+ 3038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:01.690475 (+ 889us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:01.690483 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:01.690485 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:01.690612 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:01.691055 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:01.691059 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:01.691061 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:01.691477 (+ 416us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:01.691806 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:01.692210 (+ 404us) server_negotiation.cc:299] Negotiation successful
0619 06:39:01.692421 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 06:39:01.693427 18274 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:01.792367 18559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.791285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:53158)
0619 06:39:01.792037 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.792150 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":505,"threads_started":1}
I20260619 06:39:01.793969 18559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.793522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33459 (local address 127.0.0.1:53172)
0619 06:39:01.793706 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:01.793815 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:33459: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260619 06:39:01.822360 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 18142
I20260619 06:39:01.849231 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 18292
I20260619 06:39:01.863554 18525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:01.850099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50238 (local address 127.10.192.67:35425)
0619 06:39:01.850365 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:01.850372 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:01.850392 (+ 20us) server_negotiation.cc:407] Connection header received
0619 06:39:01.850594 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:01.850600 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:01.850690 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:01.850799 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:01.852190 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.852971 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.854166 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:01.854616 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:01.854751 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:01.857389 (+ 2638us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:01.857410 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:01.857428 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:01.857460 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:01.860701 (+ 3241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:01.861393 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:01.861403 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:01.861407 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:01.861564 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:01.861931 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:01.861937 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:01.861941 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:01.862301 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:01.862638 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:01.862970 (+ 332us) server_negotiation.cc:299] Negotiation successful
0619 06:39:01.863180 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 06:39:01.864490 18415 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:01.996951 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 18292
I20260619 06:39:02.017797 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 17623
I20260619 06:39:02.018888 17792 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:02.135035 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 17623
I20260619 06:39:02.156154 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 17726
I20260619 06:39:02.157264 17981 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:02.277771 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 17726
2026-06-19T06:39:02Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (11802 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:39:02 dist-test-slave-7lz4 krb5kdc[18566](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:39:02 dist-test-slave-7lz4 krb5kdc[18566](info): set up 2 sockets
Jun 19 06:39:02 dist-test-slave-7lz4 krb5kdc[18566](info): commencing operation
krb5kdc: starting...
W20260619 06:39:03.392824 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.002s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:39:03 dist-test-slave-7lz4 krb5kdc[18566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851143, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:39:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:39:03Z Disabled control of system clock
WARNING: no policy specified for oryx/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.126.keytab.
Entry for principal oryx/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.126.keytab.
I20260619 06:39:03.616102 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:39465
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.126.keytab
--principal=oryx/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:35511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:39465
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:39:03.946960 18579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:03.947266 18579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:03.947458 18579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:03.955024 18579 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:39:03.955154 18579 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260619 06:39:03.955247 18579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:03.955348 18579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:03.955451 18579 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:39:03.955562 18579 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:39:03.965984 18579 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:35511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:39465
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.126.keytab
--principal=oryx/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:39465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:03.967347 18579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:03.968799 18579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:03.981504 18585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:03.981623 18579 server_base.cc:1034] running on GCE node
W20260619 06:39:03.981482 18587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:03.981462 18584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:03.982874 18579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:03.984428 18579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:03.985643 18579 hybrid_clock.cc:648] HybridClock initialized: now 1781851143985568 us; error 58 us; skew 500 ppm
I20260619 06:39:03.985996 18579 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:39:03 dist-test-slave-7lz4 krb5kdc[18566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851143, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:39:03.989394 18579 init.cc:377] Logged in from keytab as oryx/127.10.192.126@KRBTEST.COM (short username oryx)
I20260619 06:39:03.990869 18579 webserver.cc:460] Webserver started at http://127.10.192.126:44285/ using document root <none> and password file <none>
I20260619 06:39:03.991605 18579 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:03.991775 18579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:03.992138 18579 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:03.995241 18579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "a7b6b2105b224df8b868040c03698e14"
format_stamp: "Formatted at 2026-06-19 06:39:03 on dist-test-slave-7lz4"
server_key: "a4f2ad34db9608779a98e2b970b3cfb0"
server_key_iv: "1f59d28e27ce4425c481541e323162c9"
server_key_version: "encryptionkey@0"
I20260619 06:39:03.996080 18579 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "a7b6b2105b224df8b868040c03698e14"
format_stamp: "Formatted at 2026-06-19 06:39:03 on dist-test-slave-7lz4"
server_key: "a4f2ad34db9608779a98e2b970b3cfb0"
server_key_iv: "1f59d28e27ce4425c481541e323162c9"
server_key_version: "encryptionkey@0"
I20260619 06:39:04.001364 18579 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260619 06:39:04.004885 18594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:04.006281 18579 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:39:04.006474 18579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "a7b6b2105b224df8b868040c03698e14"
format_stamp: "Formatted at 2026-06-19 06:39:03 on dist-test-slave-7lz4"
server_key: "a4f2ad34db9608779a98e2b970b3cfb0"
server_key_iv: "1f59d28e27ce4425c481541e323162c9"
server_key_version: "encryptionkey@0"
I20260619 06:39:04.006706 18579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:04.037590 18579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:04.043442 18579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:04.043753 18579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:04.065227 18579 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:39465
I20260619 06:39:04.065246 18655 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:39465 every 8 connection(s)
I20260619 06:39:04.066624 18579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:39:04.068148 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 18579
I20260619 06:39:04.068370 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:39:04.069178 11009 external_mini_cluster.cc:1428] Setting key 8ed8871ef1bc225db0b2c8935a99e59a
I20260619 06:39:04.071643 18656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Jun 19 06:39:04 dist-test-slave-7lz4 krb5kdc[18566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851143, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM
I20260619 06:39:04.085108 18656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14: Bootstrap starting.
I20260619 06:39:04.089582 18656 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:04.090919 18656 log.cc:824] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14: Log is configured to *not* fsync() on all Append() calls
I20260619 06:39:04.094605 18656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14: No bootstrap required, opened a new log
I20260619 06:39:04.094947 18659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:04.071247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53524 (local address 127.10.192.126:39465)
0619 06:39:04.072067 (+ 820us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:04.072083 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:04.072132 (+ 49us) server_negotiation.cc:407] Connection header received
0619 06:39:04.074444 (+ 2312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:04.074471 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:04.075016 (+ 545us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:04.075482 (+ 466us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:04.076852 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:04.078958 (+ 2106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:04.080336 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:04.081378 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:04.081585 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:04.085994 (+ 4409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:04.086004 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:04.086025 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:04.086080 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:04.090282 (+ 4202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:04.091041 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:04.091052 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:04.091063 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:04.091262 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:04.091748 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:04.091754 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:04.091756 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:04.092371 (+ 615us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:04.092672 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:04.093065 (+ 393us) server_negotiation.cc:299] Negotiation successful
0619 06:39:04.093516 (+ 451us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":375,"threads_started":1}
I20260619 06:39:04.102213 18656 raft_consensus.cc:348] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7b6b2105b224df8b868040c03698e14" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39465 } }
I20260619 06:39:04.102586 18656 raft_consensus.cc:374] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:04.102662 18656 raft_consensus.cc:729] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7b6b2105b224df8b868040c03698e14, State: Initialized, Role: FOLLOWER
I20260619 06:39:04.103152 18656 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7b6b2105b224df8b868040c03698e14" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39465 } }
I20260619 06:39:04.103343 18656 raft_consensus.cc:388] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:39:04.103444 18656 raft_consensus.cc:482] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:39:04.103579 18656 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:04.105739 18656 raft_consensus.cc:504] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7b6b2105b224df8b868040c03698e14" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39465 } }
I20260619 06:39:04.106329 18656 leader_election.cc:302] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7b6b2105b224df8b868040c03698e14; no voters:
I20260619 06:39:04.106932 18656 leader_election.cc:288] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:39:04.107041 18661 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:39:04.107826 18661 raft_consensus.cc:686] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14 [term 1 LEADER]: Becoming Leader. State: Replica: a7b6b2105b224df8b868040c03698e14, State: Running, Role: LEADER
I20260619 06:39:04.108397 18661 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7b6b2105b224df8b868040c03698e14" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39465 } }
I20260619 06:39:04.109117 18656 sys_catalog.cc:564] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:39:04.111253 18662 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a7b6b2105b224df8b868040c03698e14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7b6b2105b224df8b868040c03698e14" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39465 } } }
I20260619 06:39:04.111696 18662 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14 [sys.catalog]: This master's current role is: LEADER
I20260619 06:39:04.111287 18663 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7b6b2105b224df8b868040c03698e14. Latest consensus state: current_term: 1 leader_uuid: "a7b6b2105b224df8b868040c03698e14" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7b6b2105b224df8b868040c03698e14" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39465 } } }
I20260619 06:39:04.112586 18663 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14 [sys.catalog]: This master's current role is: LEADER
I20260619 06:39:04.113346 18666 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:39:04.119114 18666 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:39:04.128803 18666 catalog_manager.cc:1347] Generated new cluster ID: 988de0158bc246a0aa8836f0e7c9bd45
I20260619 06:39:04.128940 18666 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:39:04.164779 18666 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:39:04.166172 18666 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:39:04.175240 18666 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14: Generated new TSK 0
I20260619 06:39:04.176508 18666 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.65.keytab.
Entry for principal oryx/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.65.keytab.
I20260619 06:39:04.241711 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39465
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.65.keytab
--principal=oryx/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:35511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:39:04.583829 18682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:04.584169 18682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:04.584340 18682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:04.591593 18682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:04.591765 18682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:04.591864 18682 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 06:39:04.591966 18682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:39:04.602308 18682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:35511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.65.keytab
--principal=oryx/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.192.126:39465
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:04.603623 18682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:04.605140 18682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:04.619143 18688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:04.619189 18687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:04.619867 18690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:04.619964 18682 server_base.cc:1034] running on GCE node
I20260619 06:39:04.620723 18682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:04.621760 18682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:04.623028 18682 hybrid_clock.cc:648] HybridClock initialized: now 1781851144622958 us; error 44 us; skew 500 ppm
I20260619 06:39:04.623359 18682 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:39:04 dist-test-slave-7lz4 krb5kdc[18566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851144, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:39:04.626791 18682 init.cc:377] Logged in from keytab as oryx/127.10.192.65@KRBTEST.COM (short username oryx)
I20260619 06:39:04.628293 18682 webserver.cc:460] Webserver started at http://127.10.192.65:32947/ using document root <none> and password file <none>
I20260619 06:39:04.629016 18682 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:04.629137 18682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:04.629487 18682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:04.632498 18682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "39d899187a6f46eda44bcdf2c0de931f"
format_stamp: "Formatted at 2026-06-19 06:39:04 on dist-test-slave-7lz4"
server_key: "61fe864e0c50237384e6e62878c3db50"
server_key_iv: "5ccaaf6e7608de248041bb7150c2280b"
server_key_version: "encryptionkey@0"
I20260619 06:39:04.633468 18682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "39d899187a6f46eda44bcdf2c0de931f"
format_stamp: "Formatted at 2026-06-19 06:39:04 on dist-test-slave-7lz4"
server_key: "61fe864e0c50237384e6e62878c3db50"
server_key_iv: "5ccaaf6e7608de248041bb7150c2280b"
server_key_version: "encryptionkey@0"
I20260619 06:39:04.638767 18682 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 06:39:04.642369 18697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:04.643910 18682 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:39:04.644124 18682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "39d899187a6f46eda44bcdf2c0de931f"
format_stamp: "Formatted at 2026-06-19 06:39:04 on dist-test-slave-7lz4"
server_key: "61fe864e0c50237384e6e62878c3db50"
server_key_iv: "5ccaaf6e7608de248041bb7150c2280b"
server_key_version: "encryptionkey@0"
I20260619 06:39:04.644366 18682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:04.658550 18682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:04.663156 18682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:04.663457 18682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:04.666114 18682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:39:04.666234 18682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:04.666427 18682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:39:04.666510 18682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 06:39:04 dist-test-slave-7lz4 krb5kdc[18566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851144, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM
I20260619 06:39:04.691172 18706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:04.666941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:44543 (local address 127.10.192.126:39465)
0619 06:39:04.667497 (+ 556us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:04.667503 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:04.668835 (+ 1332us) server_negotiation.cc:407] Connection header received
0619 06:39:04.670869 (+ 2034us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:04.670875 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:04.670991 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:04.671116 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:04.674077 (+ 2961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:04.675052 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:04.677749 (+ 2697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:04.678627 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:04.678790 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:04.684240 (+ 5450us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:04.684250 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:04.684257 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:04.684310 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:04.687762 (+ 3452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:04.688673 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:04.688680 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:04.688683 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:04.688811 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:04.689299 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:04.689305 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:04.689308 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:04.689613 (+ 305us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:04.689798 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:04.690572 (+ 774us) server_negotiation.cc:299] Negotiation successful
0619 06:39:04.690793 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":430,"thread_start_us":321,"threads_started":1}
I20260619 06:39:04.692749 18707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:04.667709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39465 (local address 127.10.192.65:44543)
0619 06:39:04.668625 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:04.668676 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:04.670571 (+ 1895us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:04.671594 (+ 1023us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:04.671608 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:04.672703 (+ 1095us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:04.673856 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:04.673892 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:04.675306 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:04.675318 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:04.677549 (+ 2231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:04.677570 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:04.678881 (+ 1311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:04.678887 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:04.679081 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:04.679989 (+ 908us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:04.680024 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:04.683909 (+ 3885us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:39:04.687925 (+ 4016us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:04.687942 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:04.687968 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:04.688536 (+ 568us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:04.688928 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:04.688933 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:04.688944 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:04.689152 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:04.689782 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:39:04.689790 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:39:04.690177 (+ 387us) client_negotiation.cc:769] Sending connection context
0619 06:39:04.690453 (+ 276us) client_negotiation.cc:240] Negotiation successful
0619 06:39:04.691036 (+ 583us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":388,"threads_started":1}
I20260619 06:39:04.727047 18780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:04.699286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39465 (local address 127.10.192.65:47105)
0619 06:39:04.700057 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:04.700083 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:04.700268 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:04.700620 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:04.700628 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:04.701425 (+ 797us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:04.701925 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:04.701943 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:04.714766 (+ 12823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:04.714778 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:04.717152 (+ 2374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:04.717188 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:04.718569 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:04.718579 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:04.718801 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:04.719550 (+ 749us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:04.719575 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:04.720660 (+ 1085us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:39:04.723845 (+ 3185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:04.723850 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:04.723854 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:04.724525 (+ 671us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:04.724919 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:04.724924 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:04.724928 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:04.725125 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:04.725919 (+ 794us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:39:04.725927 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:39:04.726135 (+ 208us) client_negotiation.cc:769] Sending connection context
0619 06:39:04.726372 (+ 237us) client_negotiation.cc:240] Negotiation successful
0619 06:39:04.726706 (+ 334us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":371,"threads_started":1}
I20260619 06:39:04.727401 18706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:04.699362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:47105 (local address 127.10.192.126:39465)
0619 06:39:04.699614 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:04.699624 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:04.700187 (+ 563us) server_negotiation.cc:407] Connection header received
0619 06:39:04.700388 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:04.700392 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:04.700467 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:04.700550 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:04.702146 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:04.712007 (+ 9861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:04.717418 (+ 5411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:04.718105 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:04.718254 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:04.720893 (+ 2639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:04.720899 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:04.720902 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:04.720937 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:04.723712 (+ 2775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:04.724662 (+ 950us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:04.724667 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:04.724671 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:04.724799 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:04.725288 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:04.725295 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:04.725298 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:04.725650 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:04.725832 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:04.726537 (+ 705us) server_negotiation.cc:299] Negotiation successful
0619 06:39:04.726887 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260619 06:39:04.734879 18682 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:35671
I20260619 06:39:04.734886 18817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:35671 every 8 connection(s)
I20260619 06:39:04.736212 18682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:39:04.738263 18818 heartbeater.cc:347] Connected to a master server at 127.10.192.126:39465
I20260619 06:39:04.738329 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 18682
I20260619 06:39:04.738517 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:39:04.738528 18818 heartbeater.cc:464] Registering TS with master...
I20260619 06:39:04.739339 11009 external_mini_cluster.cc:1428] Setting key 4bd4ac64267a0959aecccc0252e9f17a
I20260619 06:39:04.739341 18818 heartbeater.cc:511] Master 127.10.192.126:39465 requested a full tablet report, sending...
I20260619 06:39:04.741905 18610 ts_manager.cc:194] Registered new tserver with Master: 39d899187a6f46eda44bcdf2c0de931f (127.10.192.65:35671)
I20260619 06:39:04.743518 18610 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:44543
WARNING: no policy specified for oryx/127.10.192.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.192.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.66.keytab.
Entry for principal oryx/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.66.keytab.
I20260619 06:39:04.789039 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39465
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.66.keytab
--principal=oryx/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:35511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:39:05.131263 18822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:05.131572 18822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:05.131747 18822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:05.139213 18822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:05.139335 18822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:05.139422 18822 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 06:39:05.139504 18822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:39:05.149518 18822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:35511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.66.keytab
--principal=oryx/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.192.126:39465
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:05.150786 18822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:05.152253 18822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:05.165511 18827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:05.165582 18830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:05.165546 18828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:05.166425 18822 server_base.cc:1034] running on GCE node
I20260619 06:39:05.167083 18822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:05.168171 18822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:05.169456 18822 hybrid_clock.cc:648] HybridClock initialized: now 1781851145169381 us; error 40 us; skew 500 ppm
I20260619 06:39:05.169767 18822 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:39:05 dist-test-slave-7lz4 krb5kdc[18566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851145, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:39:05.173045 18822 init.cc:377] Logged in from keytab as oryx/127.10.192.66@KRBTEST.COM (short username oryx)
I20260619 06:39:05.174592 18822 webserver.cc:460] Webserver started at http://127.10.192.66:37749/ using document root <none> and password file <none>
I20260619 06:39:05.175354 18822 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:05.175488 18822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:05.175874 18822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:05.178813 18822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "150dc1273cb0405982cc0f335011edaf"
format_stamp: "Formatted at 2026-06-19 06:39:05 on dist-test-slave-7lz4"
server_key: "efa691ac70e398b7a68d4dbf77efabc4"
server_key_iv: "34d647f947db9c2618f41892428efc63"
server_key_version: "encryptionkey@0"
I20260619 06:39:05.179742 18822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "150dc1273cb0405982cc0f335011edaf"
format_stamp: "Formatted at 2026-06-19 06:39:05 on dist-test-slave-7lz4"
server_key: "efa691ac70e398b7a68d4dbf77efabc4"
server_key_iv: "34d647f947db9c2618f41892428efc63"
server_key_version: "encryptionkey@0"
I20260619 06:39:05.185001 18822 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260619 06:39:05.188601 18837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:05.190035 18822 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:39:05.190204 18822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "150dc1273cb0405982cc0f335011edaf"
format_stamp: "Formatted at 2026-06-19 06:39:05 on dist-test-slave-7lz4"
server_key: "efa691ac70e398b7a68d4dbf77efabc4"
server_key_iv: "34d647f947db9c2618f41892428efc63"
server_key_version: "encryptionkey@0"
I20260619 06:39:05.190438 18822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:05.215207 18822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:05.219681 18822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:05.219980 18822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:05.222892 18822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:39:05.223009 18822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:05.223140 18822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:39:05.223209 18822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 06:39:05 dist-test-slave-7lz4 krb5kdc[18566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851145, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM
I20260619 06:39:05.247588 18706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:05.223712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:51999 (local address 127.10.192.126:39465)
0619 06:39:05.223930 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:05.223936 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:05.225793 (+ 1857us) server_negotiation.cc:407] Connection header received
0619 06:39:05.228029 (+ 2236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:05.228037 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:05.228143 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:05.228269 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:05.230775 (+ 2506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.231913 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.233647 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.234078 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.234218 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:05.239451 (+ 5233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:05.239457 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:05.239460 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:05.239495 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:05.243080 (+ 3585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:05.244353 (+ 1273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:05.244361 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:05.244376 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:05.244552 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:05.245191 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:05.245199 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:05.245204 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:05.245629 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:05.245841 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:05.246976 (+ 1135us) server_negotiation.cc:299] Negotiation successful
0619 06:39:05.247214 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 06:39:05.249400 18846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:05.224705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39465 (local address 127.10.192.66:51999)
0619 06:39:05.225625 (+ 920us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:05.225672 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:05.227578 (+ 1906us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:05.228604 (+ 1026us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:05.228613 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:05.229554 (+ 941us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:05.230568 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:05.230597 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.232116 (+ 1519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.232124 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:05.233488 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:05.233500 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.234319 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.234325 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:05.234729 (+ 404us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:05.235588 (+ 859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:05.235667 (+ 79us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:05.239156 (+ 3489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:39:05.243320 (+ 4164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:05.243332 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:05.243360 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:05.244205 (+ 845us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:05.244711 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:05.244718 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:05.244722 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:05.245023 (+ 301us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:05.245818 (+ 795us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:39:05.245829 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:39:05.246436 (+ 607us) client_negotiation.cc:769] Sending connection context
0619 06:39:05.246858 (+ 422us) client_negotiation.cc:240] Negotiation successful
0619 06:39:05.247473 (+ 615us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":671,"thread_start_us":360,"threads_started":1}
I20260619 06:39:05.270257 18706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:05.255265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:46335 (local address 127.10.192.126:39465)
0619 06:39:05.255437 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:05.255442 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:05.256129 (+ 687us) server_negotiation.cc:407] Connection header received
0619 06:39:05.256326 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:05.256331 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:05.256403 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:05.256503 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:05.257444 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.258182 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.260263 (+ 2081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.260846 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.260995 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:05.263480 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:05.263490 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:05.263498 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:05.263550 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:05.267347 (+ 3797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:05.268195 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:05.268201 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:05.268204 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:05.268355 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:05.268768 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:05.268777 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:05.268780 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:05.269104 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:05.269264 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:05.269685 (+ 421us) server_negotiation.cc:299] Negotiation successful
0619 06:39:05.269902 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260619 06:39:05.270404 18904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:05.255379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39465 (local address 127.10.192.66:46335)
0619 06:39:05.256023 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:05.256039 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:05.256196 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:05.256528 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:05.256533 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:05.257017 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:05.257296 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:05.257305 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.258326 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.258331 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:05.260068 (+ 1737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:05.260089 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.261056 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.261064 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:05.261270 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:05.261984 (+ 714us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:05.262015 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:05.263237 (+ 1222us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:39:05.267510 (+ 4273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:05.267516 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:05.267520 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:05.268064 (+ 544us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:05.268489 (+ 425us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:05.268494 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:05.268498 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:05.268645 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:05.269227 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:39:05.269232 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:39:05.269438 (+ 206us) client_negotiation.cc:769] Sending connection context
0619 06:39:05.269582 (+ 144us) client_negotiation.cc:240] Negotiation successful
0619 06:39:05.269949 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":391,"threads_started":1}
I20260619 06:39:05.279208 18822 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:38131
I20260619 06:39:05.279227 18956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:38131 every 8 connection(s)
I20260619 06:39:05.280570 18822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:39:05.281769 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 18822
I20260619 06:39:05.281941 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:39:05.282553 11009 external_mini_cluster.cc:1428] Setting key c58cbb865ac9b29d8ca767955dc581ee
I20260619 06:39:05.282873 18957 heartbeater.cc:347] Connected to a master server at 127.10.192.126:39465
I20260619 06:39:05.283107 18957 heartbeater.cc:464] Registering TS with master...
I20260619 06:39:05.283943 18957 heartbeater.cc:511] Master 127.10.192.126:39465 requested a full tablet report, sending...
I20260619 06:39:05.285421 18610 ts_manager.cc:194] Registered new tserver with Master: 150dc1273cb0405982cc0f335011edaf (127.10.192.66:38131)
I20260619 06:39:05.286268 18610 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:51999
WARNING: no policy specified for oryx/127.10.192.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.192.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.67.keytab.
Entry for principal oryx/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.67.keytab.
I20260619 06:39:05.330895 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39465
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.67.keytab
--principal=oryx/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:35511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:39:05.662988 18961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:05.663353 18961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:05.663532 18961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:05.671141 18961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:05.671312 18961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:05.671482 18961 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260619 06:39:05.671661 18961 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:39:05.681740 18961 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:35511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.67.keytab
--principal=oryx/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.10.192.126:39465
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:05.683133 18961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:05.684571 18961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:05.698163 18969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:05.698143 18967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:05.698822 18966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:05.698836 18961 server_base.cc:1034] running on GCE node
I20260619 06:39:05.699540 18961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:05.700519 18961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:05.701767 18961 hybrid_clock.cc:648] HybridClock initialized: now 1781851145701672 us; error 65 us; skew 500 ppm
I20260619 06:39:05.702100 18961 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:39:05 dist-test-slave-7lz4 krb5kdc[18566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851145, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:39:05.705418 18961 init.cc:377] Logged in from keytab as oryx/127.10.192.67@KRBTEST.COM (short username oryx)
I20260619 06:39:05.707038 18961 webserver.cc:460] Webserver started at http://127.10.192.67:42369/ using document root <none> and password file <none>
I20260619 06:39:05.707851 18961 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:05.707984 18961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:05.708304 18961 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:05.711553 18961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "d917ca731d554c789079e077c714966c"
format_stamp: "Formatted at 2026-06-19 06:39:05 on dist-test-slave-7lz4"
server_key: "7dd028d6181113f3fa8ab5a256e91d3f"
server_key_iv: "fdc543357d66fcdf5500d930cc31320a"
server_key_version: "encryptionkey@0"
I20260619 06:39:05.712419 18961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "d917ca731d554c789079e077c714966c"
format_stamp: "Formatted at 2026-06-19 06:39:05 on dist-test-slave-7lz4"
server_key: "7dd028d6181113f3fa8ab5a256e91d3f"
server_key_iv: "fdc543357d66fcdf5500d930cc31320a"
server_key_version: "encryptionkey@0"
I20260619 06:39:05.717743 18961 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s
I20260619 06:39:05.721488 18976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:05.722908 18961 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 06:39:05.723088 18961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "d917ca731d554c789079e077c714966c"
format_stamp: "Formatted at 2026-06-19 06:39:05 on dist-test-slave-7lz4"
server_key: "7dd028d6181113f3fa8ab5a256e91d3f"
server_key_iv: "fdc543357d66fcdf5500d930cc31320a"
server_key_version: "encryptionkey@0"
I20260619 06:39:05.723322 18961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:05.746245 18961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:05.747110 18818 heartbeater.cc:503] Master 127.10.192.126:39465 was elected leader, sending a full tablet report...
I20260619 06:39:05.751232 18961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:05.751471 18961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:05.754290 18961 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:39:05.754383 18961 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:05.754565 18961 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:39:05.754652 18961 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 06:39:05 dist-test-slave-7lz4 krb5kdc[18566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851145, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM
I20260619 06:39:05.780131 18706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:05.754742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:37683 (local address 127.10.192.126:39465)
0619 06:39:05.754973 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:05.754983 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:05.756749 (+ 1766us) server_negotiation.cc:407] Connection header received
0619 06:39:05.758859 (+ 2110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:05.758874 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:05.758969 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:05.759079 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:05.761664 (+ 2585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.762806 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.766293 (+ 3487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.766856 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.767013 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:05.772048 (+ 5035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:05.772054 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:05.772057 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:05.772098 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:05.775896 (+ 3798us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:05.776996 (+ 1100us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:05.777002 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:05.777005 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:05.777173 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:05.777704 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:05.777713 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:05.777719 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:05.778247 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:05.778434 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:05.779331 (+ 897us) server_negotiation.cc:299] Negotiation successful
0619 06:39:05.779614 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260619 06:39:05.781406 18985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:05.755552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39465 (local address 127.10.192.67:37683)
0619 06:39:05.756558 (+ 1006us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:05.756605 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:05.758557 (+ 1952us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:05.759552 (+ 995us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:05.759568 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:05.760444 (+ 876us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:05.761450 (+ 1006us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:05.761485 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.763017 (+ 1532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.763023 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:05.766093 (+ 3070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:05.766116 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.767166 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.767175 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:05.767564 (+ 389us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:05.768542 (+ 978us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:05.768579 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:05.771785 (+ 3206us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:39:05.776106 (+ 4321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:05.776117 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:05.776147 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:05.776834 (+ 687us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:05.777314 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:05.777319 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:05.777324 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:05.777547 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:05.778428 (+ 881us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:39:05.778433 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:39:05.778792 (+ 359us) client_negotiation.cc:769] Sending connection context
0619 06:39:05.779152 (+ 360us) client_negotiation.cc:240] Negotiation successful
0619 06:39:05.779905 (+ 753us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":715,"thread_start_us":390,"threads_started":1}
I20260619 06:39:05.807273 19060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:05.789356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39465 (local address 127.10.192.67:57595)
0619 06:39:05.790483 (+ 1127us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:05.790503 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:05.790637 (+ 134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:05.791075 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:05.791082 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:05.791750 (+ 668us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:05.792205 (+ 455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:05.792216 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.793853 (+ 1637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.793857 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:05.795322 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:05.795342 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.796772 (+ 1430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.796783 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:05.797072 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:05.797955 (+ 883us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:05.797976 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:05.799212 (+ 1236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:39:05.804125 (+ 4913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:05.804134 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:05.804141 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:05.804948 (+ 807us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:05.805465 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:05.805469 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:05.805471 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:05.805600 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:05.806282 (+ 682us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:39:05.806287 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:39:05.806500 (+ 213us) client_negotiation.cc:769] Sending connection context
0619 06:39:05.806655 (+ 155us) client_negotiation.cc:240] Negotiation successful
0619 06:39:05.806937 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":981,"thread_start_us":817,"threads_started":1}
I20260619 06:39:05.807659 18706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:05.789410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:57595 (local address 127.10.192.126:39465)
0619 06:39:05.789628 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:05.789636 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:05.790613 (+ 977us) server_negotiation.cc:407] Connection header received
0619 06:39:05.790763 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:05.790771 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:05.790889 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:05.791018 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:05.792454 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.793720 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.795499 (+ 1779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.796318 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.796485 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:05.799433 (+ 2948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:05.799443 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:05.799450 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:05.799502 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:05.803921 (+ 4419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:05.805141 (+ 1220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:05.805147 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:05.805150 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:05.805311 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:05.805727 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:05.805731 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:05.805734 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:05.806141 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:05.806301 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:05.806804 (+ 503us) server_negotiation.cc:299] Negotiation successful
0619 06:39:05.807145 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260619 06:39:05.808646 19095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:37621 every 8 connection(s)
I20260619 06:39:05.808686 18961 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:37621
I20260619 06:39:05.810432 18961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:39:05.812570 19096 heartbeater.cc:347] Connected to a master server at 127.10.192.126:39465
I20260619 06:39:05.812803 19096 heartbeater.cc:464] Registering TS with master...
I20260619 06:39:05.813408 19096 heartbeater.cc:511] Master 127.10.192.126:39465 requested a full tablet report, sending...
I20260619 06:39:05.813880 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 18961
I20260619 06:39:05.814043 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:39:05.814599 11009 external_mini_cluster.cc:1428] Setting key 57fa02fc323b39d9d0a09f887cc33715
I20260619 06:39:05.814890 18610 ts_manager.cc:194] Registered new tserver with Master: d917ca731d554c789079e077c714966c (127.10.192.67:37621)
I20260619 06:39:05.816025 18610 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:37683
I20260619 06:39:05.817651 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 19 06:39:05 dist-test-slave-7lz4 krb5kdc[18566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851145, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Jun 19 06:39:05 dist-test-slave-7lz4 krb5kdc[18566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:05 dist-test-slave-7lz4 krb5kdc[18566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
W20260619 06:39:05.868325 18706 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:05.857725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44610 (local address 127.10.192.126:39465)
0619 06:39:05.857964 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:05.857971 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:05.858162 (+ 191us) server_negotiation.cc:407] Connection header received
0619 06:39:05.858420 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:05.858426 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:05.858500 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:05.858609 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:05.859954 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.860694 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.861978 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.862414 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.862565 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:05.868012 (+ 5447us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44610: BlockingRecv error: recv got EOF from 127.0.0.1:44610 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Jun 19 06:39:05 dist-test-slave-7lz4 krb5kdc[18566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851145, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM
I20260619 06:39:05.883855 18706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:05.871002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44624 (local address 127.10.192.126:39465)
0619 06:39:05.871257 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:05.871263 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:05.871488 (+ 225us) server_negotiation.cc:407] Connection header received
0619 06:39:05.871624 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:05.871669 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:05.871749 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:05.871833 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:05.872882 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.873605 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.874768 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.875156 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.875247 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:05.878929 (+ 3682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:05.878935 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:05.878939 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:05.878972 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:05.881468 (+ 2496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:05.882123 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:05.882126 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:05.882129 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:05.882245 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:05.882563 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:05.882566 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:05.882568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:05.882821 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:05.883047 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:05.883303 (+ 256us) server_negotiation.cc:299] Negotiation successful
0619 06:39:05.883488 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260619 06:39:05.888620 18610 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44624:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:39:05.895961 18610 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:39:05.921578 19118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:05.911992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:37621 (local address 127.0.0.1:36400)
0619 06:39:05.913921 (+ 1929us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:05.913948 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:05.914064 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:05.914670 (+ 606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:05.914675 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:05.914701 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:39:05.915050 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:05.915061 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.917155 (+ 2094us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.917161 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:05.918795 (+ 1634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:05.918808 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.920552 (+ 1744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.920560 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:05.920731 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:05.920761 (+ 30us) client_negotiation.cc:769] Sending connection context
0619 06:39:05.920843 (+ 82us) client_negotiation.cc:240] Negotiation successful
0619 06:39:05.921094 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1816,"mutex_wait_us":50,"thread_start_us":1671,"threads_started":1}
I20260619 06:39:05.921720 19115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:05.908896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58116 (local address 127.10.192.66:38131)
0619 06:39:05.910897 (+ 2001us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:05.910903 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:05.911261 (+ 358us) server_negotiation.cc:407] Connection header received
0619 06:39:05.912062 (+ 801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:05.912073 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:05.912338 (+ 265us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:05.912534 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:39:05.913724 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.915133 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.918356 (+ 3223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.919860 (+ 1504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.920009 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:05.920222 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:05.921283 (+ 1061us) server_negotiation.cc:299] Negotiation successful
0619 06:39:05.921456 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1851,"thread_start_us":1751,"threads_started":1}
I20260619 06:39:05.921761 19114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:05.908967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:35671 (local address 127.0.0.1:34834)
0619 06:39:05.911737 (+ 2770us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:05.911753 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:05.911879 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:05.912768 (+ 889us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:05.912776 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:05.912817 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:39:05.913391 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:05.913408 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.915239 (+ 1831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.915245 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:05.918175 (+ 2930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:05.918189 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.920956 (+ 2767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.920963 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:05.921113 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:05.921146 (+ 33us) client_negotiation.cc:769] Sending connection context
0619 06:39:05.921232 (+ 86us) client_negotiation.cc:240] Negotiation successful
0619 06:39:05.921352 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2631,"mutex_wait_us":134,"spinlock_wait_cycles":896,"thread_start_us":1330,"threads_started":1}
I20260619 06:39:05.922214 19119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:05.912417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36400 (local address 127.10.192.67:37621)
0619 06:39:05.913506 (+ 1089us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:05.913518 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:05.914058 (+ 540us) server_negotiation.cc:407] Connection header received
0619 06:39:05.914201 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:05.914208 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:05.914470 (+ 262us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:05.914664 (+ 194us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:39:05.915616 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.917012 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.918985 (+ 1973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.920195 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.920328 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:05.921110 (+ 782us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:05.921195 (+ 85us) server_negotiation.cc:299] Negotiation successful
0619 06:39:05.921370 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":911,"thread_start_us":703,"threads_started":1}
I20260619 06:39:05.922315 19116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:05.908741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:38131 (local address 127.0.0.1:58116)
0619 06:39:05.911112 (+ 2371us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:05.911150 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:05.911362 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:05.912768 (+ 1406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:05.912776 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:05.912824 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:39:05.913482 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:05.913501 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.915352 (+ 1851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.915356 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:05.918182 (+ 2826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:05.918191 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.920368 (+ 2177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.920375 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:05.920628 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:05.920685 (+ 57us) client_negotiation.cc:769] Sending connection context
0619 06:39:05.920815 (+ 130us) client_negotiation.cc:240] Negotiation successful
0619 06:39:05.921082 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1712,"mutex_wait_us":193,"spinlock_wait_cycles":7424,"thread_start_us":2691,"threads_started":1}
I20260619 06:39:05.922531 19117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:05.909373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34834 (local address 127.10.192.65:35671)
0619 06:39:05.910109 (+ 736us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:05.910123 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:05.912031 (+ 1908us) server_negotiation.cc:407] Connection header received
0619 06:39:05.912120 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:05.912126 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:05.912337 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:05.912534 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:39:05.913653 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.915081 (+ 1428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.919004 (+ 3923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:05.920454 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:05.920581 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:05.920788 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:05.922045 (+ 1257us) server_negotiation.cc:299] Negotiation successful
0619 06:39:05.922223 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":535,"thread_start_us":417,"threads_started":1}
I20260619 06:39:05.926005 18887 tablet_service.cc:1467] Processing CreateTablet for tablet fbfd6e9811fc49a8b2de4aa7d6380f0b (DEFAULT_TABLE table=test-table [id=823e7a76852f43a3a69d22033f76df7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:39:05.926013 19026 tablet_service.cc:1467] Processing CreateTablet for tablet fbfd6e9811fc49a8b2de4aa7d6380f0b (DEFAULT_TABLE table=test-table [id=823e7a76852f43a3a69d22033f76df7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:39:05.926013 18748 tablet_service.cc:1467] Processing CreateTablet for tablet fbfd6e9811fc49a8b2de4aa7d6380f0b (DEFAULT_TABLE table=test-table [id=823e7a76852f43a3a69d22033f76df7b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:39:05.927392 18887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbfd6e9811fc49a8b2de4aa7d6380f0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:05.927429 19026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbfd6e9811fc49a8b2de4aa7d6380f0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:05.927489 18748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fbfd6e9811fc49a8b2de4aa7d6380f0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:05.940663 19120 tablet_bootstrap.cc:492] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf: Bootstrap starting.
I20260619 06:39:05.945838 19121 tablet_bootstrap.cc:492] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f: Bootstrap starting.
I20260619 06:39:05.946139 19120 tablet_bootstrap.cc:654] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:05.946816 19122 tablet_bootstrap.cc:492] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c: Bootstrap starting.
I20260619 06:39:05.947506 19120 log.cc:824] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf: Log is configured to *not* fsync() on all Append() calls
I20260619 06:39:05.950517 19120 tablet_bootstrap.cc:492] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf: No bootstrap required, opened a new log
I20260619 06:39:05.950809 19120 ts_tablet_manager.cc:1397] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260619 06:39:05.951537 19121 tablet_bootstrap.cc:654] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:05.951537 19122 tablet_bootstrap.cc:654] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:05.952867 19122 log.cc:824] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c: Log is configured to *not* fsync() on all Append() calls
I20260619 06:39:05.952865 19121 log.cc:824] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f: Log is configured to *not* fsync() on all Append() calls
I20260619 06:39:05.955688 19121 tablet_bootstrap.cc:492] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f: No bootstrap required, opened a new log
I20260619 06:39:05.955976 19121 ts_tablet_manager.cc:1397] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.002s
I20260619 06:39:05.956104 19122 tablet_bootstrap.cc:492] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c: No bootstrap required, opened a new log
I20260619 06:39:05.956353 19122 ts_tablet_manager.cc:1397] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260619 06:39:05.961261 19120 raft_consensus.cc:348] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:05.961710 19120 raft_consensus.cc:374] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:05.961810 19120 raft_consensus.cc:729] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150dc1273cb0405982cc0f335011edaf, State: Initialized, Role: FOLLOWER
I20260619 06:39:05.962479 19120 consensus_queue.cc:260] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:05.963621 18957 heartbeater.cc:503] Master 127.10.192.126:39465 was elected leader, sending a full tablet report...
I20260619 06:39:05.964361 19120 ts_tablet_manager.cc:1428] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf: Time spent starting tablet: real 0.013s user 0.015s sys 0.000s
I20260619 06:39:05.964257 19121 raft_consensus.cc:348] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:05.964689 19121 raft_consensus.cc:374] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:05.964784 19121 raft_consensus.cc:729] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d899187a6f46eda44bcdf2c0de931f, State: Initialized, Role: FOLLOWER
I20260619 06:39:05.965497 19121 consensus_queue.cc:260] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:05.966858 19122 raft_consensus.cc:348] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:05.967268 19121 ts_tablet_manager.cc:1428] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f: Time spent starting tablet: real 0.011s user 0.008s sys 0.002s
I20260619 06:39:05.967285 19122 raft_consensus.cc:374] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:05.967410 19122 raft_consensus.cc:729] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d917ca731d554c789079e077c714966c, State: Initialized, Role: FOLLOWER
I20260619 06:39:05.968077 19122 consensus_queue.cc:260] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:05.969214 19096 heartbeater.cc:503] Master 127.10.192.126:39465 was elected leader, sending a full tablet report...
I20260619 06:39:05.971166 19122 ts_tablet_manager.cc:1428] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c: Time spent starting tablet: real 0.015s user 0.013s sys 0.000s
W20260619 06:39:05.988704 18819 tablet.cc:2369] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 06:39:06.032743 18958 tablet.cc:2369] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 06:39:06.062319 19097 tablet.cc:2369] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:39:06.164242 19128 raft_consensus.cc:482] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:39:06.164644 19128 raft_consensus.cc:504] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:06.166445 19128 leader_election.cc:288] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150dc1273cb0405982cc0f335011edaf (127.10.192.66:38131), 39d899187a6f46eda44bcdf2c0de931f (127.10.192.65:35671)
I20260619 06:39:06.174400 19117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:06.167029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:48559 (local address 127.10.192.65:35671)
0619 06:39:06.167226 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:06.167233 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:06.167257 (+ 24us) server_negotiation.cc:407] Connection header received
0619 06:39:06.167587 (+ 330us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:06.167595 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:06.167734 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:06.167867 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:39:06.168464 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.169516 (+ 1052us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.172056 (+ 2540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.173277 (+ 1221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.173458 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:06.173537 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:06.173995 (+ 458us) server_negotiation.cc:299] Negotiation successful
0619 06:39:06.174149 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260619 06:39:06.174484 19115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:06.167022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:44891 (local address 127.10.192.66:38131)
0619 06:39:06.167226 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:06.167233 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:06.167993 (+ 760us) server_negotiation.cc:407] Connection header received
0619 06:39:06.168186 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:06.168194 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:06.168269 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:06.168360 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:39:06.169019 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.169876 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.172262 (+ 2386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.173510 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.173664 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:06.173713 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:06.174080 (+ 367us) server_negotiation.cc:299] Negotiation successful
0619 06:39:06.174197 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260619 06:39:06.174554 19129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:06.166912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:38131 (local address 127.10.192.67:44891)
0619 06:39:06.167870 (+ 958us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:06.167890 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:06.168038 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:06.168407 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:06.168412 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:06.168453 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:39:06.168856 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:06.168870 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.170002 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.170008 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:06.172122 (+ 2114us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:06.172132 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.173744 (+ 1612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.173752 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:06.173943 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:06.173970 (+ 27us) client_negotiation.cc:769] Sending connection context
0619 06:39:06.174045 (+ 75us) client_negotiation.cc:240] Negotiation successful
0619 06:39:06.174144 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":803,"mutex_wait_us":5,"thread_start_us":569,"threads_started":1}
I20260619 06:39:06.174757 18985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:06.166792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:35671 (local address 127.10.192.67:48559)
0619 06:39:06.167133 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:06.167156 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:06.167307 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:06.167888 (+ 581us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:06.167892 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:06.167916 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:39:06.168234 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:06.168245 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.169676 (+ 1431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.169682 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:06.171876 (+ 2194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:06.171893 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.173523 (+ 1630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.173528 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:06.173789 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:06.173834 (+ 45us) client_negotiation.cc:769] Sending connection context
0619 06:39:06.173948 (+ 114us) client_negotiation.cc:240] Negotiation successful
0619 06:39:06.174100 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"mutex_wait_us":33,"spinlock_wait_cycles":24832}
I20260619 06:39:06.175781 18912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbfd6e9811fc49a8b2de4aa7d6380f0b" candidate_uuid: "d917ca731d554c789079e077c714966c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150dc1273cb0405982cc0f335011edaf" is_pre_election: true
I20260619 06:39:06.175812 18768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbfd6e9811fc49a8b2de4aa7d6380f0b" candidate_uuid: "d917ca731d554c789079e077c714966c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d899187a6f46eda44bcdf2c0de931f" is_pre_election: true
I20260619 06:39:06.176401 18912 raft_consensus.cc:2454] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d917ca731d554c789079e077c714966c in term 0.
I20260619 06:39:06.176395 18768 raft_consensus.cc:2454] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d917ca731d554c789079e077c714966c in term 0.
I20260619 06:39:06.177150 18979 leader_election.cc:302] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d899187a6f46eda44bcdf2c0de931f, d917ca731d554c789079e077c714966c; no voters:
I20260619 06:39:06.177579 19128 raft_consensus.cc:2781] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:39:06.177735 19128 raft_consensus.cc:482] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:39:06.177836 19128 raft_consensus.cc:3037] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:06.180148 19128 raft_consensus.cc:504] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:06.180729 19128 leader_election.cc:288] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [CANDIDATE]: Term 1 election: Requested vote from peers 150dc1273cb0405982cc0f335011edaf (127.10.192.66:38131), 39d899187a6f46eda44bcdf2c0de931f (127.10.192.65:35671)
I20260619 06:39:06.181208 18912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbfd6e9811fc49a8b2de4aa7d6380f0b" candidate_uuid: "d917ca731d554c789079e077c714966c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150dc1273cb0405982cc0f335011edaf"
I20260619 06:39:06.181236 18768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbfd6e9811fc49a8b2de4aa7d6380f0b" candidate_uuid: "d917ca731d554c789079e077c714966c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d899187a6f46eda44bcdf2c0de931f"
I20260619 06:39:06.181428 18912 raft_consensus.cc:3037] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:06.181422 18768 raft_consensus.cc:3037] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:06.183759 18768 raft_consensus.cc:2454] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d917ca731d554c789079e077c714966c in term 1.
I20260619 06:39:06.183809 18912 raft_consensus.cc:2454] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d917ca731d554c789079e077c714966c in term 1.
I20260619 06:39:06.184180 18979 leader_election.cc:302] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d899187a6f46eda44bcdf2c0de931f, d917ca731d554c789079e077c714966c; no voters:
I20260619 06:39:06.184466 19128 raft_consensus.cc:2781] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:39:06.184970 19128 raft_consensus.cc:686] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [term 1 LEADER]: Becoming Leader. State: Replica: d917ca731d554c789079e077c714966c, State: Running, Role: LEADER
I20260619 06:39:06.185465 19128 consensus_queue.cc:237] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:06.190037 18611 catalog_manager.cc:5495] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c reported cstate change: term changed from 0 to 1, leader changed from <none> to d917ca731d554c789079e077c714966c (127.10.192.67). New cstate: current_term: 1 leader_uuid: "d917ca731d554c789079e077c714966c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } health_report { overall_health: HEALTHY } } }
I20260619 06:39:06.216719 19119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:06.211586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36406 (local address 127.10.192.67:37621)
0619 06:39:06.211849 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:06.211854 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:06.211872 (+ 18us) server_negotiation.cc:407] Connection header received
0619 06:39:06.212065 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:06.212069 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:06.212154 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:06.212276 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:39:06.212574 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.213267 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.214504 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.214912 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.215006 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:06.215498 (+ 492us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:39:06.216089 (+ 591us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:39:06.216196 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:06.216343 (+ 147us) server_negotiation.cc:299] Negotiation successful
0619 06:39:06.216416 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260619 06:39:06.225454 18912 raft_consensus.cc:1261] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf [term 1 FOLLOWER]: Refusing update from remote peer d917ca731d554c789079e077c714966c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:39:06.225454 18768 raft_consensus.cc:1261] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f [term 1 FOLLOWER]: Refusing update from remote peer d917ca731d554c789079e077c714966c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:39:06.226562 19130 consensus_queue.cc:1035] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [LEADER]: Connected to new peer: Peer: permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:39:06.226984 19128 consensus_queue.cc:1035] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [LEADER]: Connected to new peer: Peer: permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:39:06.242372 19134 mvcc.cc:205] Tried to move back new op lower bound from 7298462294928068608 to 7298462294779523072. Current Snapshot: MvccSnapshot[applied={T|T < 7298462294928068608}]
I20260619 06:39:06.256198 18611 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44624:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:39:06.256508 18611 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44624:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:39:06.260608 18611 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14: Sending DeleteTablet for 3 replicas of tablet fbfd6e9811fc49a8b2de4aa7d6380f0b
I20260619 06:39:06.261934 18887 tablet_service.cc:1514] Processing DeleteTablet for tablet fbfd6e9811fc49a8b2de4aa7d6380f0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:06 UTC) from {username='oryx', principal='oryx/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:58116
I20260619 06:39:06.261957 19026 tablet_service.cc:1514] Processing DeleteTablet for tablet fbfd6e9811fc49a8b2de4aa7d6380f0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:06 UTC) from {username='oryx', principal='oryx/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:36400
I20260619 06:39:06.262027 18748 tablet_service.cc:1514] Processing DeleteTablet for tablet fbfd6e9811fc49a8b2de4aa7d6380f0b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:06 UTC) from {username='oryx', principal='oryx/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:34834
I20260619 06:39:06.264043 18611 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44624:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:39:06.264989 18611 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:39:06.269366 19145 tablet_replica.cc:330] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f: stopping tablet replica
I20260619 06:39:06.269765 19143 tablet_replica.cc:330] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf: stopping tablet replica
I20260619 06:39:06.270326 19143 raft_consensus.cc:2229] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:39:06.270957 19143 raft_consensus.cc:2258] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:39:06.271054 19145 raft_consensus.cc:2229] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:39:06.271564 19145 raft_consensus.cc:2258] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:39:06.272979 19144 tablet_replica.cc:330] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c: stopping tablet replica
I20260619 06:39:06.273424 19144 raft_consensus.cc:2229] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:39:06.273717 19143 ts_tablet_manager.cc:1905] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:39:06.274151 19144 raft_consensus.cc:2258] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:39:06.275678 18748 tablet_service.cc:1467] Processing CreateTablet for tablet 55ae70ef0c2e4d7a957db2542da7a36d (DEFAULT_TABLE table=test-table [id=4bf7c00da71f460087a182322d5aa089]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:39:06.275863 19145 ts_tablet_manager.cc:1905] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:39:06.276083 18887 tablet_service.cc:1467] Processing CreateTablet for tablet 55ae70ef0c2e4d7a957db2542da7a36d (DEFAULT_TABLE table=test-table [id=4bf7c00da71f460087a182322d5aa089]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:39:06.276417 18748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55ae70ef0c2e4d7a957db2542da7a36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:06.276528 18887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55ae70ef0c2e4d7a957db2542da7a36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:06.282202 19143 ts_tablet_manager.cc:1918] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:39:06.282487 19143 log.cc:1196] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/fbfd6e9811fc49a8b2de4aa7d6380f0b
I20260619 06:39:06.283033 19121 tablet_bootstrap.cc:492] T 55ae70ef0c2e4d7a957db2542da7a36d P 39d899187a6f46eda44bcdf2c0de931f: Bootstrap starting.
I20260619 06:39:06.283318 19120 tablet_bootstrap.cc:492] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf: Bootstrap starting.
I20260619 06:39:06.284770 19121 tablet_bootstrap.cc:654] T 55ae70ef0c2e4d7a957db2542da7a36d P 39d899187a6f46eda44bcdf2c0de931f: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:06.285171 19120 tablet_bootstrap.cc:654] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:06.289523 19143 ts_tablet_manager.cc:1939] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 150dc1273cb0405982cc0f335011edaf: Deleting consensus metadata
I20260619 06:39:06.289750 19026 tablet_service.cc:1467] Processing CreateTablet for tablet 55ae70ef0c2e4d7a957db2542da7a36d (DEFAULT_TABLE table=test-table [id=4bf7c00da71f460087a182322d5aa089]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:39:06.290270 19026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55ae70ef0c2e4d7a957db2542da7a36d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:06.292557 18596 catalog_manager.cc:4841] TS 150dc1273cb0405982cc0f335011edaf (127.10.192.66:38131): tablet fbfd6e9811fc49a8b2de4aa7d6380f0b (table test-table [id=823e7a76852f43a3a69d22033f76df7b]) successfully deleted
I20260619 06:39:06.294718 19144 ts_tablet_manager.cc:1905] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:39:06.297731 19121 tablet_bootstrap.cc:492] T 55ae70ef0c2e4d7a957db2542da7a36d P 39d899187a6f46eda44bcdf2c0de931f: No bootstrap required, opened a new log
I20260619 06:39:06.297916 19121 ts_tablet_manager.cc:1397] T 55ae70ef0c2e4d7a957db2542da7a36d P 39d899187a6f46eda44bcdf2c0de931f: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.011s
I20260619 06:39:06.298840 19121 raft_consensus.cc:348] T 55ae70ef0c2e4d7a957db2542da7a36d P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:06.299086 19121 raft_consensus.cc:374] T 55ae70ef0c2e4d7a957db2542da7a36d P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:06.299196 19121 raft_consensus.cc:729] T 55ae70ef0c2e4d7a957db2542da7a36d P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d899187a6f46eda44bcdf2c0de931f, State: Initialized, Role: FOLLOWER
I20260619 06:39:06.299484 19121 consensus_queue.cc:260] T 55ae70ef0c2e4d7a957db2542da7a36d P 39d899187a6f46eda44bcdf2c0de931f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:06.301664 19120 tablet_bootstrap.cc:492] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf: No bootstrap required, opened a new log
I20260619 06:39:06.301857 19120 ts_tablet_manager.cc:1397] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf: Time spent bootstrapping tablet: real 0.019s user 0.009s sys 0.004s
I20260619 06:39:06.302742 19120 raft_consensus.cc:348] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:06.302995 19120 raft_consensus.cc:374] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:06.303100 19120 raft_consensus.cc:729] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150dc1273cb0405982cc0f335011edaf, State: Initialized, Role: FOLLOWER
I20260619 06:39:06.303421 19120 consensus_queue.cc:260] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:06.303851 19121 ts_tablet_manager.cc:1428] T 55ae70ef0c2e4d7a957db2542da7a36d P 39d899187a6f46eda44bcdf2c0de931f: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s
I20260619 06:39:06.305671 19120 ts_tablet_manager.cc:1428] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260619 06:39:06.307862 19145 ts_tablet_manager.cc:1918] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:39:06.309737 19145 log.cc:1196] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/fbfd6e9811fc49a8b2de4aa7d6380f0b
I20260619 06:39:06.310477 19145 ts_tablet_manager.cc:1939] T fbfd6e9811fc49a8b2de4aa7d6380f0b P 39d899187a6f46eda44bcdf2c0de931f: Deleting consensus metadata
I20260619 06:39:06.311278 19122 tablet_bootstrap.cc:492] T 55ae70ef0c2e4d7a957db2542da7a36d P d917ca731d554c789079e077c714966c: Bootstrap starting.
I20260619 06:39:06.312932 19144 ts_tablet_manager.cc:1918] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:39:06.313145 19144 log.cc:1196] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/fbfd6e9811fc49a8b2de4aa7d6380f0b
I20260619 06:39:06.313177 19122 tablet_bootstrap.cc:654] T 55ae70ef0c2e4d7a957db2542da7a36d P d917ca731d554c789079e077c714966c: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:06.313691 19144 ts_tablet_manager.cc:1939] T fbfd6e9811fc49a8b2de4aa7d6380f0b P d917ca731d554c789079e077c714966c: Deleting consensus metadata
I20260619 06:39:06.314258 18597 catalog_manager.cc:4841] TS 39d899187a6f46eda44bcdf2c0de931f (127.10.192.65:35671): tablet fbfd6e9811fc49a8b2de4aa7d6380f0b (table test-table [id=823e7a76852f43a3a69d22033f76df7b]) successfully deleted
I20260619 06:39:06.315578 18595 catalog_manager.cc:4841] TS d917ca731d554c789079e077c714966c (127.10.192.67:37621): tablet fbfd6e9811fc49a8b2de4aa7d6380f0b (table test-table [id=823e7a76852f43a3a69d22033f76df7b]) successfully deleted
I20260619 06:39:06.316820 19122 tablet_bootstrap.cc:492] T 55ae70ef0c2e4d7a957db2542da7a36d P d917ca731d554c789079e077c714966c: No bootstrap required, opened a new log
I20260619 06:39:06.316996 19122 ts_tablet_manager.cc:1397] T 55ae70ef0c2e4d7a957db2542da7a36d P d917ca731d554c789079e077c714966c: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260619 06:39:06.317891 19122 raft_consensus.cc:348] T 55ae70ef0c2e4d7a957db2542da7a36d P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:06.318190 19122 raft_consensus.cc:374] T 55ae70ef0c2e4d7a957db2542da7a36d P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:06.318308 19122 raft_consensus.cc:729] T 55ae70ef0c2e4d7a957db2542da7a36d P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d917ca731d554c789079e077c714966c, State: Initialized, Role: FOLLOWER
I20260619 06:39:06.318622 19122 consensus_queue.cc:260] T 55ae70ef0c2e4d7a957db2542da7a36d P d917ca731d554c789079e077c714966c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:06.319396 19122 ts_tablet_manager.cc:1428] T 55ae70ef0c2e4d7a957db2542da7a36d P d917ca731d554c789079e077c714966c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 06:39:06.712798 19126 raft_consensus.cc:482] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:39:06.713003 19126 raft_consensus.cc:504] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:06.714478 19126 leader_election.cc:288] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39d899187a6f46eda44bcdf2c0de931f (127.10.192.65:35671), d917ca731d554c789079e077c714966c (127.10.192.67:37621)
I20260619 06:39:06.722134 19119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:06.714898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:60671 (local address 127.10.192.67:37621)
0619 06:39:06.715143 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:06.715153 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:06.716666 (+ 1513us) server_negotiation.cc:407] Connection header received
0619 06:39:06.716753 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:06.716759 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:06.716848 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:06.716952 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:39:06.717535 (+ 583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.718214 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.720222 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.721076 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.721249 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:06.721334 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:06.721707 (+ 373us) server_negotiation.cc:299] Negotiation successful
0619 06:39:06.721840 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260619 06:39:06.722236 19150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:06.714720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:35671 (local address 127.10.192.66:46007)
0619 06:39:06.715856 (+ 1136us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:06.715878 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:06.716019 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:06.716413 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:06.716419 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:06.716444 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:39:06.716821 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:06.716830 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.718130 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.718136 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:06.719976 (+ 1840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:06.719998 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.721233 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.721239 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:06.721500 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:06.721537 (+ 37us) client_negotiation.cc:769] Sending connection context
0619 06:39:06.721640 (+ 103us) client_negotiation.cc:240] Negotiation successful
0619 06:39:06.721804 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":993,"mutex_wait_us":310,"thread_start_us":1444,"threads_started":1}
I20260619 06:39:06.722282 19149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:06.714820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:37621 (local address 127.10.192.66:60671)
0619 06:39:06.716513 (+ 1693us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:06.716530 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:06.716640 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:06.717024 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:06.717032 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:06.717060 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:39:06.717381 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:06.717393 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.718352 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.718360 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:06.720062 (+ 1702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:06.720077 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.721292 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.721299 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:06.721512 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:06.721553 (+ 41us) client_negotiation.cc:769] Sending connection context
0619 06:39:06.721671 (+ 118us) client_negotiation.cc:240] Negotiation successful
0619 06:39:06.721830 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1566,"mutex_wait_us":49,"thread_start_us":778,"threads_started":1}
I20260619 06:39:06.722153 19151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:06.714942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:46007 (local address 127.10.192.65:35671)
0619 06:39:06.715705 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:06.715715 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:06.715986 (+ 271us) server_negotiation.cc:407] Connection header received
0619 06:39:06.716146 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:06.716155 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:06.716242 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:06.716374 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:39:06.716986 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.717968 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.720157 (+ 2189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.721054 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.721231 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:06.721309 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:06.721673 (+ 364us) server_negotiation.cc:299] Negotiation successful
0619 06:39:06.721813 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":429,"threads_started":1}
I20260619 06:39:06.723050 18768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55ae70ef0c2e4d7a957db2542da7a36d" candidate_uuid: "150dc1273cb0405982cc0f335011edaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d899187a6f46eda44bcdf2c0de931f" is_pre_election: true
I20260619 06:39:06.723315 18768 raft_consensus.cc:2454] T 55ae70ef0c2e4d7a957db2542da7a36d P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 150dc1273cb0405982cc0f335011edaf in term 0.
I20260619 06:39:06.723445 19046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55ae70ef0c2e4d7a957db2542da7a36d" candidate_uuid: "150dc1273cb0405982cc0f335011edaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d917ca731d554c789079e077c714966c" is_pre_election: true
I20260619 06:39:06.723888 19046 raft_consensus.cc:2454] T 55ae70ef0c2e4d7a957db2542da7a36d P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 150dc1273cb0405982cc0f335011edaf in term 0.
I20260619 06:39:06.723834 18840 leader_election.cc:302] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150dc1273cb0405982cc0f335011edaf, 39d899187a6f46eda44bcdf2c0de931f; no voters:
I20260619 06:39:06.724272 19126 raft_consensus.cc:2781] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:39:06.724426 19126 raft_consensus.cc:482] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:39:06.724550 19126 raft_consensus.cc:3037] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:06.726773 19126 raft_consensus.cc:504] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:06.727421 19126 leader_election.cc:288] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [CANDIDATE]: Term 1 election: Requested vote from peers 39d899187a6f46eda44bcdf2c0de931f (127.10.192.65:35671), d917ca731d554c789079e077c714966c (127.10.192.67:37621)
I20260619 06:39:06.727922 18768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55ae70ef0c2e4d7a957db2542da7a36d" candidate_uuid: "150dc1273cb0405982cc0f335011edaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d899187a6f46eda44bcdf2c0de931f"
I20260619 06:39:06.727949 19046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55ae70ef0c2e4d7a957db2542da7a36d" candidate_uuid: "150dc1273cb0405982cc0f335011edaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d917ca731d554c789079e077c714966c"
I20260619 06:39:06.728129 18768 raft_consensus.cc:3037] T 55ae70ef0c2e4d7a957db2542da7a36d P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:06.728137 19046 raft_consensus.cc:3037] T 55ae70ef0c2e4d7a957db2542da7a36d P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:06.730095 18768 raft_consensus.cc:2454] T 55ae70ef0c2e4d7a957db2542da7a36d P 39d899187a6f46eda44bcdf2c0de931f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150dc1273cb0405982cc0f335011edaf in term 1.
I20260619 06:39:06.730159 19046 raft_consensus.cc:2454] T 55ae70ef0c2e4d7a957db2542da7a36d P d917ca731d554c789079e077c714966c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150dc1273cb0405982cc0f335011edaf in term 1.
I20260619 06:39:06.730659 18838 leader_election.cc:302] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150dc1273cb0405982cc0f335011edaf, d917ca731d554c789079e077c714966c; no voters:
I20260619 06:39:06.730989 19126 raft_consensus.cc:2781] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:39:06.731360 19126 raft_consensus.cc:686] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [term 1 LEADER]: Becoming Leader. State: Replica: 150dc1273cb0405982cc0f335011edaf, State: Running, Role: LEADER
I20260619 06:39:06.731786 19126 consensus_queue.cc:237] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:06.734863 18611 catalog_manager.cc:5495] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 150dc1273cb0405982cc0f335011edaf (127.10.192.66). New cstate: current_term: 1 leader_uuid: "150dc1273cb0405982cc0f335011edaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } health_report { overall_health: UNKNOWN } } }
Jun 19 06:39:06 dist-test-slave-7lz4 krb5kdc[18566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851143, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.126@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM
I20260619 06:39:06.804157 19160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:06.786177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39465 (local address 127.0.0.1:44630)
0619 06:39:06.787114 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:06.787140 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:06.787271 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:06.787614 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:06.787617 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:06.788341 (+ 724us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:06.788527 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:06.788536 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.789596 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.789600 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:06.790548 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:06.790559 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.791281 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.791289 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:06.791436 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:06.796192 (+ 4756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:06.796213 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:06.798498 (+ 2285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:39:06.801797 (+ 3299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:06.801808 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:06.801815 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:06.802230 (+ 415us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:06.802587 (+ 357us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:06.802590 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:06.802593 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:06.802725 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:06.803201 (+ 476us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:39:06.803207 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:39:06.803359 (+ 152us) client_negotiation.cc:769] Sending connection context
0619 06:39:06.803496 (+ 137us) client_negotiation.cc:240] Negotiation successful
0619 06:39:06.803805 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":727,"thread_start_us":517,"threads_started":1}
I20260619 06:39:06.804333 19159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:06.786193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44630 (local address 127.10.192.126:39465)
0619 06:39:06.787222 (+ 1029us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:06.787226 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:06.787249 (+ 23us) server_negotiation.cc:407] Connection header received
0619 06:39:06.787416 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:06.787420 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:06.787476 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:06.787569 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:06.788676 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.789463 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.790678 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:06.791081 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:06.791183 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:06.798745 (+ 7562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:06.798750 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:06.798753 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:06.798784 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:06.801661 (+ 2877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:06.802334 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:06.802338 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:06.802340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:06.802492 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:06.802812 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:06.802815 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:06.802817 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:06.803095 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:06.803202 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:06.803624 (+ 422us) server_negotiation.cc:299] Negotiation successful
0619 06:39:06.803939 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":49,"server-negotiator.queue_time_us":928,"thread_start_us":794,"threads_started":1}
I20260619 06:39:06.809762 18611 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:44630:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260619 06:39:06.811111 18611 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:39:06.818607 18887 tablet_service.cc:1467] Processing CreateTablet for tablet f17fcdac9fe84e4c9a837c05bdf2dbb9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9bafd679b4584a54bfcacaeb178f104f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 06:39:06.818607 18748 tablet_service.cc:1467] Processing CreateTablet for tablet f17fcdac9fe84e4c9a837c05bdf2dbb9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9bafd679b4584a54bfcacaeb178f104f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 06:39:06.818718 19026 tablet_service.cc:1467] Processing CreateTablet for tablet f17fcdac9fe84e4c9a837c05bdf2dbb9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9bafd679b4584a54bfcacaeb178f104f]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260619 06:39:06.819173 18748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f17fcdac9fe84e4c9a837c05bdf2dbb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:06.819168 18887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f17fcdac9fe84e4c9a837c05bdf2dbb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:06.819218 19026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f17fcdac9fe84e4c9a837c05bdf2dbb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:06.831825 19163 tablet_bootstrap.cc:492] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P d917ca731d554c789079e077c714966c: Bootstrap starting.
I20260619 06:39:06.833644 19163 tablet_bootstrap.cc:654] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P d917ca731d554c789079e077c714966c: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:06.833783 19162 tablet_bootstrap.cc:492] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 150dc1273cb0405982cc0f335011edaf: Bootstrap starting.
I20260619 06:39:06.835553 19162 tablet_bootstrap.cc:654] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 150dc1273cb0405982cc0f335011edaf: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:06.836789 19161 tablet_bootstrap.cc:492] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f: Bootstrap starting.
I20260619 06:39:06.839022 19161 tablet_bootstrap.cc:654] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:06.840863 19162 tablet_bootstrap.cc:492] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 150dc1273cb0405982cc0f335011edaf: No bootstrap required, opened a new log
I20260619 06:39:06.841066 19162 ts_tablet_manager.cc:1397] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 150dc1273cb0405982cc0f335011edaf: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.000s
I20260619 06:39:06.841827 19162 raft_consensus.cc:348] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:06.842109 19162 raft_consensus.cc:374] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:06.842202 19162 raft_consensus.cc:729] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150dc1273cb0405982cc0f335011edaf, State: Initialized, Role: FOLLOWER
I20260619 06:39:06.842469 19162 consensus_queue.cc:260] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 150dc1273cb0405982cc0f335011edaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:06.843088 19162 ts_tablet_manager.cc:1428] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 150dc1273cb0405982cc0f335011edaf: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 06:39:06.842919 19126 tablet_replica.cc:439] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 150dc1273cb0405982cc0f335011edaf: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } } }
I20260619 06:39:06.843971 19126 tablet_replica.cc:442] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 150dc1273cb0405982cc0f335011edaf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:39:06.845088 19163 tablet_bootstrap.cc:492] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P d917ca731d554c789079e077c714966c: No bootstrap required, opened a new log
I20260619 06:39:06.845280 19163 ts_tablet_manager.cc:1397] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P d917ca731d554c789079e077c714966c: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.003s
I20260619 06:39:06.845530 19161 tablet_bootstrap.cc:492] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f: No bootstrap required, opened a new log
I20260619 06:39:06.845681 19161 ts_tablet_manager.cc:1397] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s
I20260619 06:39:06.846128 19163 raft_consensus.cc:348] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:06.846359 19163 raft_consensus.cc:374] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:06.846457 19163 raft_consensus.cc:729] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d917ca731d554c789079e077c714966c, State: Initialized, Role: FOLLOWER
I20260619 06:39:06.846494 19161 raft_consensus.cc:348] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:06.846733 19161 raft_consensus.cc:374] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:06.846813 19161 raft_consensus.cc:729] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d899187a6f46eda44bcdf2c0de931f, State: Initialized, Role: FOLLOWER
I20260619 06:39:06.846688 19163 consensus_queue.cc:260] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P d917ca731d554c789079e077c714966c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:06.847018 19161 consensus_queue.cc:260] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:06.847576 19163 ts_tablet_manager.cc:1428] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P d917ca731d554c789079e077c714966c: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260619 06:39:06.847913 19168 tablet_replica.cc:439] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } } }
I20260619 06:39:06.848143 19167 tablet_replica.cc:439] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P d917ca731d554c789079e077c714966c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } } }
I20260619 06:39:06.848460 19167 tablet_replica.cc:442] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P d917ca731d554c789079e077c714966c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:39:06.848485 19168 tablet_replica.cc:442] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:39:06.847939 19161 ts_tablet_manager.cc:1428] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260619 06:39:07.139747 19126 consensus_queue.cc:1035] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:39:07.146000 19152 consensus_queue.cc:1035] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:39:07.153452 19168 raft_consensus.cc:482] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:39:07.153635 19168 raft_consensus.cc:504] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.155472 19168 leader_election.cc:288] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150dc1273cb0405982cc0f335011edaf (127.10.192.66:38131), d917ca731d554c789079e077c714966c (127.10.192.67:37621)
I20260619 06:39:07.164601 19119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:07.156044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:34183 (local address 127.10.192.67:37621)
0619 06:39:07.156286 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:07.156294 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:07.157041 (+ 747us) server_negotiation.cc:407] Connection header received
0619 06:39:07.157397 (+ 356us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:07.157401 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:07.157460 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:07.157581 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:39:07.158280 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.159355 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.162272 (+ 2917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.163567 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.163772 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:07.163847 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:07.164126 (+ 279us) server_negotiation.cc:299] Negotiation successful
0619 06:39:07.164274 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260619 06:39:07.164741 19177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:07.155877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:37621 (local address 127.10.192.65:34183)
0619 06:39:07.156909 (+ 1032us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:07.156955 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:07.157187 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:07.157611 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:07.157616 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:07.157640 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:39:07.158080 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:07.158097 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.159492 (+ 1395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.159496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:07.162074 (+ 2578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:07.162090 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.163768 (+ 1678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.163775 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:07.163952 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:07.163988 (+ 36us) client_negotiation.cc:769] Sending connection context
0619 06:39:07.164105 (+ 117us) client_negotiation.cc:240] Negotiation successful
0619 06:39:07.164250 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":820,"mutex_wait_us":145,"thread_start_us":1253,"threads_started":1}
I20260619 06:39:07.164812 19175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:07.155868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:38359 (local address 127.10.192.66:38131)
0619 06:39:07.157247 (+ 1379us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:07.157255 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:07.157526 (+ 271us) server_negotiation.cc:407] Connection header received
0619 06:39:07.157655 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:07.157659 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:07.157733 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:07.157822 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:39:07.158522 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.159609 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.162272 (+ 2663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.163555 (+ 1283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.163781 (+ 226us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:07.163847 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:07.164306 (+ 459us) server_negotiation.cc:299] Negotiation successful
0619 06:39:07.164450 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1246,"thread_start_us":1044,"threads_started":1}
I20260619 06:39:07.165266 19176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:07.155959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:38131 (local address 127.10.192.65:38359)
0619 06:39:07.157425 (+ 1466us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:07.157441 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:07.157529 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:07.157871 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:07.157875 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:07.157894 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:39:07.158372 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:07.158380 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.159759 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.159765 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:07.162079 (+ 2314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:07.162090 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.164018 (+ 1928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.164022 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:07.164147 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:07.164172 (+ 25us) client_negotiation.cc:769] Sending connection context
0619 06:39:07.164281 (+ 109us) client_negotiation.cc:240] Negotiation successful
0619 06:39:07.164417 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1353,"mutex_wait_us":35,"thread_start_us":549,"threads_started":1}
I20260619 06:39:07.165423 19046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f17fcdac9fe84e4c9a837c05bdf2dbb9" candidate_uuid: "39d899187a6f46eda44bcdf2c0de931f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d917ca731d554c789079e077c714966c" is_pre_election: true
I20260619 06:39:07.165742 19046 raft_consensus.cc:2454] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39d899187a6f46eda44bcdf2c0de931f in term 0.
I20260619 06:39:07.165967 18912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f17fcdac9fe84e4c9a837c05bdf2dbb9" candidate_uuid: "39d899187a6f46eda44bcdf2c0de931f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150dc1273cb0405982cc0f335011edaf" is_pre_election: true
I20260619 06:39:07.166224 18912 raft_consensus.cc:2454] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39d899187a6f46eda44bcdf2c0de931f in term 0.
I20260619 06:39:07.166247 18698 leader_election.cc:302] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d899187a6f46eda44bcdf2c0de931f, d917ca731d554c789079e077c714966c; no voters:
I20260619 06:39:07.166690 19168 raft_consensus.cc:2781] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:39:07.166816 19168 raft_consensus.cc:482] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:39:07.166919 19168 raft_consensus.cc:3037] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:07.169201 19168 raft_consensus.cc:504] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.169862 19168 leader_election.cc:288] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f [CANDIDATE]: Term 1 election: Requested vote from peers 150dc1273cb0405982cc0f335011edaf (127.10.192.66:38131), d917ca731d554c789079e077c714966c (127.10.192.67:37621)
I20260619 06:39:07.170308 18912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f17fcdac9fe84e4c9a837c05bdf2dbb9" candidate_uuid: "39d899187a6f46eda44bcdf2c0de931f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150dc1273cb0405982cc0f335011edaf"
I20260619 06:39:07.170351 19046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f17fcdac9fe84e4c9a837c05bdf2dbb9" candidate_uuid: "39d899187a6f46eda44bcdf2c0de931f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d917ca731d554c789079e077c714966c"
I20260619 06:39:07.170495 18912 raft_consensus.cc:3037] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:07.170643 19046 raft_consensus.cc:3037] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:07.172518 18912 raft_consensus.cc:2454] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 150dc1273cb0405982cc0f335011edaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d899187a6f46eda44bcdf2c0de931f in term 1.
I20260619 06:39:07.172732 19046 raft_consensus.cc:2454] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P d917ca731d554c789079e077c714966c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d899187a6f46eda44bcdf2c0de931f in term 1.
I20260619 06:39:07.172977 18699 leader_election.cc:302] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150dc1273cb0405982cc0f335011edaf, 39d899187a6f46eda44bcdf2c0de931f; no voters:
I20260619 06:39:07.173277 19168 raft_consensus.cc:2781] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:39:07.173705 19168 raft_consensus.cc:686] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f [term 1 LEADER]: Becoming Leader. State: Replica: 39d899187a6f46eda44bcdf2c0de931f, State: Running, Role: LEADER
I20260619 06:39:07.174073 19168 consensus_queue.cc:237] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.175923 19178 tablet_replica.cc:439] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f: TxnStatusTablet state changed. Reason: New leader 39d899187a6f46eda44bcdf2c0de931f. Latest consensus state: current_term: 1 leader_uuid: "39d899187a6f46eda44bcdf2c0de931f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } } }
I20260619 06:39:07.176327 19178 tablet_replica.cc:442] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f: This TxnStatusTablet replica's current role is: LEADER
I20260619 06:39:07.177363 19180 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260619 06:39:07.177591 19180 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260619 06:39:07.177786 18610 catalog_manager.cc:5495] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f reported cstate change: term changed from 0 to 1, leader changed from <none> to 39d899187a6f46eda44bcdf2c0de931f (127.10.192.65). New cstate: current_term: 1 leader_uuid: "39d899187a6f46eda44bcdf2c0de931f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260619 06:39:07.210510 19151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:07.203731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34848 (local address 127.10.192.65:35671)
0619 06:39:07.203953 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:07.203960 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:07.204169 (+ 209us) server_negotiation.cc:407] Connection header received
0619 06:39:07.204412 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:07.204417 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:07.204555 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:07.204744 (+ 189us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:39:07.205148 (+ 404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.206344 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.207663 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.208368 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.208498 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:07.208954 (+ 456us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:39:07.209729 (+ 775us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:39:07.209898 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:07.210088 (+ 190us) server_negotiation.cc:299] Negotiation successful
0619 06:39:07.210176 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260619 06:39:07.210579 19160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:07.203849 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:35671 (local address 127.0.0.1:34848)
0619 06:39:07.204077 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:07.204095 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:07.204217 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:07.204807 (+ 590us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:07.204816 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:07.204825 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 06:39:07.205001 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:07.205008 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.206498 (+ 1490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.206502 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:07.207492 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:07.207504 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.208527 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.208532 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:07.208677 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:07.208734 (+ 57us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 06:39:07.209858 (+ 1124us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 06:39:07.209882 (+ 24us) client_negotiation.cc:769] Sending connection context
0619 06:39:07.210052 (+ 170us) client_negotiation.cc:240] Negotiation successful
0619 06:39:07.210205 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260619 06:39:07.214860 18912 raft_consensus.cc:1261] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 150dc1273cb0405982cc0f335011edaf [term 1 FOLLOWER]: Refusing update from remote peer 39d899187a6f46eda44bcdf2c0de931f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:39:07.215160 19046 raft_consensus.cc:1261] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P d917ca731d554c789079e077c714966c [term 1 FOLLOWER]: Refusing update from remote peer 39d899187a6f46eda44bcdf2c0de931f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:39:07.215620 19168 consensus_queue.cc:1035] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f [LEADER]: Connected to new peer: Peer: permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:39:07.215960 19178 consensus_queue.cc:1035] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:39:07.219672 19167 tablet_replica.cc:439] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P d917ca731d554c789079e077c714966c: TxnStatusTablet state changed. Reason: New leader 39d899187a6f46eda44bcdf2c0de931f. Latest consensus state: current_term: 1 leader_uuid: "39d899187a6f46eda44bcdf2c0de931f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } } }
I20260619 06:39:07.219408 19152 tablet_replica.cc:439] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 150dc1273cb0405982cc0f335011edaf: TxnStatusTablet state changed. Reason: New leader 39d899187a6f46eda44bcdf2c0de931f. Latest consensus state: current_term: 1 leader_uuid: "39d899187a6f46eda44bcdf2c0de931f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } } }
I20260619 06:39:07.219988 19167 tablet_replica.cc:442] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P d917ca731d554c789079e077c714966c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:39:07.220084 19152 tablet_replica.cc:442] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 150dc1273cb0405982cc0f335011edaf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:39:07.224743 19170 mvcc.cc:205] Tried to move back new op lower bound from 7298462298984923136 to 7298462298828369920. Current Snapshot: MvccSnapshot[applied={T|T < 7298462298984923136}]
I20260619 06:39:07.232851 19174 mvcc.cc:205] Tried to move back new op lower bound from 7298462298984923136 to 7298462298828369920. Current Snapshot: MvccSnapshot[applied={T|T < 7298462298984923136}]
I20260619 06:39:07.234871 19152 tablet_replica.cc:439] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 150dc1273cb0405982cc0f335011edaf: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "39d899187a6f46eda44bcdf2c0de931f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } } }
I20260619 06:39:07.235252 19152 tablet_replica.cc:442] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 150dc1273cb0405982cc0f335011edaf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:39:07.237296 19178 tablet_replica.cc:439] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39d899187a6f46eda44bcdf2c0de931f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } } }
I20260619 06:39:07.237568 19178 tablet_replica.cc:442] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f: This TxnStatusTablet replica's current role is: LEADER
I20260619 06:39:07.237900 19178 tablet_replica.cc:439] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39d899187a6f46eda44bcdf2c0de931f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } } }
I20260619 06:39:07.238180 19178 tablet_replica.cc:442] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P 39d899187a6f46eda44bcdf2c0de931f: This TxnStatusTablet replica's current role is: LEADER
I20260619 06:39:07.245244 19167 tablet_replica.cc:439] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P d917ca731d554c789079e077c714966c: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "39d899187a6f46eda44bcdf2c0de931f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } } }
I20260619 06:39:07.245524 19167 tablet_replica.cc:442] T f17fcdac9fe84e4c9a837c05bdf2dbb9 P d917ca731d554c789079e077c714966c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260619 06:39:07.251535 19175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:07.243722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58126 (local address 127.10.192.66:38131)
0619 06:39:07.243953 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:07.243962 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:07.244393 (+ 431us) server_negotiation.cc:407] Connection header received
0619 06:39:07.244639 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:07.244644 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:07.244787 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:07.244958 (+ 171us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:39:07.245721 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.246709 (+ 988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.248856 (+ 2147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.249553 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.249687 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:07.250074 (+ 387us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:39:07.250822 (+ 748us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:39:07.250998 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:07.251121 (+ 123us) server_negotiation.cc:299] Negotiation successful
0619 06:39:07.251214 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260619 06:39:07.268471 19193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:07.262054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:35671 (local address 127.10.192.66:37405)
0619 06:39:07.262889 (+ 835us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:07.262905 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:07.263043 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:07.263409 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:07.263412 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:07.263421 (+ 9us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 06:39:07.263603 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:07.263610 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.265141 (+ 1531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.265145 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:07.266230 (+ 1085us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:07.266242 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.267315 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.267320 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:07.267450 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:07.267506 (+ 56us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 06:39:07.267942 (+ 436us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 06:39:07.267951 (+ 9us) client_negotiation.cc:769] Sending connection context
0619 06:39:07.268011 (+ 60us) client_negotiation.cc:240] Negotiation successful
0619 06:39:07.268182 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":691,"thread_start_us":542,"threads_started":1}
I20260619 06:39:07.268504 19151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:07.262182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:37405 (local address 127.10.192.65:35671)
0619 06:39:07.262413 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:07.262422 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:07.262994 (+ 572us) server_negotiation.cc:407] Connection header received
0619 06:39:07.263165 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:07.263171 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:07.263282 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:07.263390 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:39:07.263788 (+ 398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.264991 (+ 1203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.266370 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.267137 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.267291 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:07.267697 (+ 406us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:39:07.267835 (+ 138us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:39:07.267926 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:07.268064 (+ 138us) server_negotiation.cc:299] Negotiation successful
0619 06:39:07.268160 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260619 06:39:07.328097 19175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:07.317995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:50491 (local address 127.10.192.66:38131)
0619 06:39:07.318206 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:07.318215 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:07.321484 (+ 3269us) server_negotiation.cc:407] Connection header received
0619 06:39:07.321728 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:07.321737 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:07.321855 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:07.321962 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:39:07.322928 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.324134 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.325773 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.326452 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.326587 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:07.327048 (+ 461us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:39:07.327189 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:39:07.327284 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:07.327683 (+ 399us) server_negotiation.cc:299] Negotiation successful
0619 06:39:07.327780 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260619 06:39:07.329151 19195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:07.317526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:38131 (local address 127.10.192.65:50491)
0619 06:39:07.321350 (+ 3824us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:07.321373 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:07.321573 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:07.322160 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:07.322169 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:07.322183 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 06:39:07.322670 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:07.322693 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.324283 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.324287 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:07.325622 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:07.325634 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.326641 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.326646 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:07.326785 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:07.326887 (+ 102us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 06:39:07.327444 (+ 557us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 06:39:07.327454 (+ 10us) client_negotiation.cc:769] Sending connection context
0619 06:39:07.328501 (+ 1047us) client_negotiation.cc:240] Negotiation successful
0619 06:39:07.328678 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3576,"thread_start_us":3384,"threads_started":1}
I20260619 06:39:07.368673 18610 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44624:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:39:07.368961 18610 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:44624:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:39:07.372704 18610 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14: Sending DeleteTablet for 3 replicas of tablet 55ae70ef0c2e4d7a957db2542da7a36d
I20260619 06:39:07.373663 18748 tablet_service.cc:1514] Processing DeleteTablet for tablet 55ae70ef0c2e4d7a957db2542da7a36d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:07 UTC) from {username='oryx', principal='oryx/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:34834
I20260619 06:39:07.374298 18887 tablet_service.cc:1514] Processing DeleteTablet for tablet 55ae70ef0c2e4d7a957db2542da7a36d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:07 UTC) from {username='oryx', principal='oryx/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:58116
I20260619 06:39:07.374742 19026 tablet_service.cc:1514] Processing DeleteTablet for tablet 55ae70ef0c2e4d7a957db2542da7a36d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:07 UTC) from {username='oryx', principal='oryx/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:36400
I20260619 06:39:07.399261 19201 tablet_replica.cc:330] T 55ae70ef0c2e4d7a957db2542da7a36d P d917ca731d554c789079e077c714966c: stopping tablet replica
I20260619 06:39:07.399537 19201 raft_consensus.cc:2229] T 55ae70ef0c2e4d7a957db2542da7a36d P d917ca731d554c789079e077c714966c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:39:07.399861 19201 raft_consensus.cc:2258] T 55ae70ef0c2e4d7a957db2542da7a36d P d917ca731d554c789079e077c714966c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:39:07.400537 19200 tablet_replica.cc:330] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf: stopping tablet replica
I20260619 06:39:07.400748 19200 raft_consensus.cc:2229] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:39:07.401403 19200 raft_consensus.cc:2258] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:39:07.402702 19201 ts_tablet_manager.cc:1905] T 55ae70ef0c2e4d7a957db2542da7a36d P d917ca731d554c789079e077c714966c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:39:07.404660 19200 ts_tablet_manager.cc:1905] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:39:07.409974 19199 tablet_replica.cc:330] T 55ae70ef0c2e4d7a957db2542da7a36d P 39d899187a6f46eda44bcdf2c0de931f: stopping tablet replica
I20260619 06:39:07.410208 19199 raft_consensus.cc:2229] T 55ae70ef0c2e4d7a957db2542da7a36d P 39d899187a6f46eda44bcdf2c0de931f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:39:07.411866 19199 raft_consensus.cc:2258] T 55ae70ef0c2e4d7a957db2542da7a36d P 39d899187a6f46eda44bcdf2c0de931f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:39:07.413146 19199 ts_tablet_manager.cc:1905] T 55ae70ef0c2e4d7a957db2542da7a36d P 39d899187a6f46eda44bcdf2c0de931f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:39:07.427222 19201 ts_tablet_manager.cc:1918] T 55ae70ef0c2e4d7a957db2542da7a36d P d917ca731d554c789079e077c714966c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 06:39:07.427403 19201 log.cc:1196] T 55ae70ef0c2e4d7a957db2542da7a36d P d917ca731d554c789079e077c714966c: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/55ae70ef0c2e4d7a957db2542da7a36d
I20260619 06:39:07.429080 19200 ts_tablet_manager.cc:1918] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 06:39:07.429241 19200 log.cc:1196] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/55ae70ef0c2e4d7a957db2542da7a36d
I20260619 06:39:07.429700 19200 ts_tablet_manager.cc:1939] T 55ae70ef0c2e4d7a957db2542da7a36d P 150dc1273cb0405982cc0f335011edaf: Deleting consensus metadata
I20260619 06:39:07.431000 18596 catalog_manager.cc:4841] TS 150dc1273cb0405982cc0f335011edaf (127.10.192.66:38131): tablet 55ae70ef0c2e4d7a957db2542da7a36d (table test-table [id=4bf7c00da71f460087a182322d5aa089]) successfully deleted
I20260619 06:39:07.433956 19199 ts_tablet_manager.cc:1918] T 55ae70ef0c2e4d7a957db2542da7a36d P 39d899187a6f46eda44bcdf2c0de931f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 06:39:07.434114 19199 log.cc:1196] T 55ae70ef0c2e4d7a957db2542da7a36d P 39d899187a6f46eda44bcdf2c0de931f: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/55ae70ef0c2e4d7a957db2542da7a36d
I20260619 06:39:07.434576 19199 ts_tablet_manager.cc:1939] T 55ae70ef0c2e4d7a957db2542da7a36d P 39d899187a6f46eda44bcdf2c0de931f: Deleting consensus metadata
I20260619 06:39:07.435885 18597 catalog_manager.cc:4841] TS 39d899187a6f46eda44bcdf2c0de931f (127.10.192.65:35671): tablet 55ae70ef0c2e4d7a957db2542da7a36d (table test-table [id=4bf7c00da71f460087a182322d5aa089]) successfully deleted
I20260619 06:39:07.436178 19201 ts_tablet_manager.cc:1939] T 55ae70ef0c2e4d7a957db2542da7a36d P d917ca731d554c789079e077c714966c: Deleting consensus metadata
I20260619 06:39:07.437500 18595 catalog_manager.cc:4841] TS d917ca731d554c789079e077c714966c (127.10.192.67:37621): tablet 55ae70ef0c2e4d7a957db2542da7a36d (table test-table [id=4bf7c00da71f460087a182322d5aa089]) successfully deleted
Jun 19 06:39:07 dist-test-slave-7lz4 krb5kdc[18566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Jun 19 06:39:07 dist-test-slave-7lz4 krb5kdc[18566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:07 dist-test-slave-7lz4 krb5kdc[18566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
W20260619 06:39:07.481377 19209 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:07.453593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44640 (local address 127.10.192.126:39465)
0619 06:39:07.464998 (+ 11405us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:07.465004 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:07.465026 (+ 22us) server_negotiation.cc:407] Connection header received
0619 06:39:07.465093 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:07.465098 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:07.465180 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:07.465328 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:07.467096 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.468335 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.470246 (+ 1911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.470850 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.470989 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:07.481062 (+ 10073us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:44640: BlockingRecv error: recv got EOF from 127.0.0.1:44640 (error 108)
Metrics: {"server-negotiator.queue_time_us":11264,"thread_start_us":11116,"threads_started":1}
Jun 19 06:39:07 dist-test-slave-7lz4 krb5kdc[18566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM
I20260619 06:39:07.502104 19209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:07.481542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44646 (local address 127.10.192.126:39465)
0619 06:39:07.481898 (+ 356us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:07.481904 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:07.482361 (+ 457us) server_negotiation.cc:407] Connection header received
0619 06:39:07.482619 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:07.482625 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:07.482700 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:07.482767 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:07.484567 (+ 1800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.485772 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.487761 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.488452 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.488559 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:07.494841 (+ 6282us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:07.494849 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:07.494855 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:07.494903 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:07.498823 (+ 3920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:07.499800 (+ 977us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:07.499806 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:07.499809 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:07.499980 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:07.500445 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:07.500449 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:07.500452 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:07.500828 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:07.501105 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:07.501433 (+ 328us) server_negotiation.cc:299] Negotiation successful
0619 06:39:07.501699 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":242,"thread_start_us":12671,"threads_started":1}
I20260619 06:39:07.506523 18610 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44646:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:39:07.507280 18610 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:39:07.515616 18887 tablet_service.cc:1467] Processing CreateTablet for tablet a19b8bbaea26464dae7f40a1dabcbe6f (DEFAULT_TABLE table=test-table [id=e61c24c970a940a0b9f0fdbd3865fb50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:39:07.516155 18887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a19b8bbaea26464dae7f40a1dabcbe6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:07.516086 19026 tablet_service.cc:1467] Processing CreateTablet for tablet a19b8bbaea26464dae7f40a1dabcbe6f (DEFAULT_TABLE table=test-table [id=e61c24c970a940a0b9f0fdbd3865fb50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:39:07.516503 19026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a19b8bbaea26464dae7f40a1dabcbe6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:07.520730 18748 tablet_service.cc:1467] Processing CreateTablet for tablet a19b8bbaea26464dae7f40a1dabcbe6f (DEFAULT_TABLE table=test-table [id=e61c24c970a940a0b9f0fdbd3865fb50]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:39:07.521227 18748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a19b8bbaea26464dae7f40a1dabcbe6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:07.530821 19216 tablet_bootstrap.cc:492] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf: Bootstrap starting.
I20260619 06:39:07.533039 19216 tablet_bootstrap.cc:654] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:07.536310 19216 tablet_bootstrap.cc:492] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf: No bootstrap required, opened a new log
I20260619 06:39:07.536490 19216 ts_tablet_manager.cc:1397] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260619 06:39:07.538600 19216 raft_consensus.cc:348] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.538893 19216 raft_consensus.cc:374] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:07.539003 19216 raft_consensus.cc:729] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150dc1273cb0405982cc0f335011edaf, State: Initialized, Role: FOLLOWER
I20260619 06:39:07.539291 19216 consensus_queue.cc:260] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.540212 19216 ts_tablet_manager.cc:1428] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s
I20260619 06:39:07.549086 19218 tablet_bootstrap.cc:492] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f: Bootstrap starting.
I20260619 06:39:07.550112 19217 tablet_bootstrap.cc:492] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c: Bootstrap starting.
I20260619 06:39:07.553294 19218 tablet_bootstrap.cc:654] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:07.554958 19217 tablet_bootstrap.cc:654] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:07.557168 19218 tablet_bootstrap.cc:492] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f: No bootstrap required, opened a new log
I20260619 06:39:07.557346 19218 ts_tablet_manager.cc:1397] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.000s
I20260619 06:39:07.558246 19218 raft_consensus.cc:348] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.558523 19218 raft_consensus.cc:374] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:07.558615 19218 raft_consensus.cc:729] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d899187a6f46eda44bcdf2c0de931f, State: Initialized, Role: FOLLOWER
I20260619 06:39:07.558897 19218 consensus_queue.cc:260] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.559610 19218 ts_tablet_manager.cc:1428] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 06:39:07.561004 19217 tablet_bootstrap.cc:492] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c: No bootstrap required, opened a new log
I20260619 06:39:07.561151 19217 ts_tablet_manager.cc:1397] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.000s
I20260619 06:39:07.561915 19217 raft_consensus.cc:348] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.562155 19217 raft_consensus.cc:374] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:07.562239 19217 raft_consensus.cc:729] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d917ca731d554c789079e077c714966c, State: Initialized, Role: FOLLOWER
I20260619 06:39:07.562516 19217 consensus_queue.cc:260] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.565259 19217 ts_tablet_manager.cc:1428] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20260619 06:39:07.669153 19171 raft_consensus.cc:482] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:39:07.669400 19171 raft_consensus.cc:504] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.670246 19171 leader_election.cc:288] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39d899187a6f46eda44bcdf2c0de931f (127.10.192.65:35671), d917ca731d554c789079e077c714966c (127.10.192.67:37621)
I20260619 06:39:07.670964 18768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19b8bbaea26464dae7f40a1dabcbe6f" candidate_uuid: "150dc1273cb0405982cc0f335011edaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d899187a6f46eda44bcdf2c0de931f" is_pre_election: true
I20260619 06:39:07.670985 19046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19b8bbaea26464dae7f40a1dabcbe6f" candidate_uuid: "150dc1273cb0405982cc0f335011edaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d917ca731d554c789079e077c714966c" is_pre_election: true
I20260619 06:39:07.671255 18768 raft_consensus.cc:2454] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 150dc1273cb0405982cc0f335011edaf in term 0.
I20260619 06:39:07.671301 19046 raft_consensus.cc:2454] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 150dc1273cb0405982cc0f335011edaf in term 0.
I20260619 06:39:07.671821 18840 leader_election.cc:302] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150dc1273cb0405982cc0f335011edaf, 39d899187a6f46eda44bcdf2c0de931f; no voters:
I20260619 06:39:07.672194 19171 raft_consensus.cc:2781] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:39:07.672335 19171 raft_consensus.cc:482] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:39:07.672428 19171 raft_consensus.cc:3037] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:07.675762 19171 raft_consensus.cc:504] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.676987 19046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19b8bbaea26464dae7f40a1dabcbe6f" candidate_uuid: "150dc1273cb0405982cc0f335011edaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d917ca731d554c789079e077c714966c"
I20260619 06:39:07.676999 18768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a19b8bbaea26464dae7f40a1dabcbe6f" candidate_uuid: "150dc1273cb0405982cc0f335011edaf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39d899187a6f46eda44bcdf2c0de931f"
I20260619 06:39:07.677218 19046 raft_consensus.cc:3037] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:07.677260 18768 raft_consensus.cc:3037] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:07.679917 19046 raft_consensus.cc:2454] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150dc1273cb0405982cc0f335011edaf in term 1.
I20260619 06:39:07.680428 18838 leader_election.cc:302] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150dc1273cb0405982cc0f335011edaf, d917ca731d554c789079e077c714966c; no voters:
I20260619 06:39:07.680631 18768 raft_consensus.cc:2454] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 150dc1273cb0405982cc0f335011edaf in term 1.
I20260619 06:39:07.680747 19126 raft_consensus.cc:2781] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:39:07.680881 19126 raft_consensus.cc:686] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [term 1 LEADER]: Becoming Leader. State: Replica: 150dc1273cb0405982cc0f335011edaf, State: Running, Role: LEADER
I20260619 06:39:07.681191 19126 consensus_queue.cc:237] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.681845 19171 leader_election.cc:288] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [CANDIDATE]: Term 1 election: Requested vote from peers 39d899187a6f46eda44bcdf2c0de931f (127.10.192.65:35671), d917ca731d554c789079e077c714966c (127.10.192.67:37621)
I20260619 06:39:07.684176 18610 catalog_manager.cc:5495] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf reported cstate change: term changed from 0 to 1, leader changed from <none> to 150dc1273cb0405982cc0f335011edaf (127.10.192.66). New cstate: current_term: 1 leader_uuid: "150dc1273cb0405982cc0f335011edaf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260619 06:39:07.701318 19175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:07.696115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58136 (local address 127.10.192.66:38131)
0619 06:39:07.696297 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:07.696304 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:07.696438 (+ 134us) server_negotiation.cc:407] Connection header received
0619 06:39:07.696680 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:07.696684 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:07.696753 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:07.696852 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:39:07.697217 (+ 365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.698036 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.699363 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.699902 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.700094 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:07.700569 (+ 475us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:39:07.700693 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:39:07.700802 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:07.700945 (+ 143us) server_negotiation.cc:299] Negotiation successful
0619 06:39:07.701028 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260619 06:39:07.704200 19046 raft_consensus.cc:1261] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c [term 1 FOLLOWER]: Refusing update from remote peer 150dc1273cb0405982cc0f335011edaf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:39:07.704241 18768 raft_consensus.cc:1261] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f [term 1 FOLLOWER]: Refusing update from remote peer 150dc1273cb0405982cc0f335011edaf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:39:07.704859 19126 consensus_queue.cc:1035] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:39:07.705410 19171 consensus_queue.cc:1035] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [LEADER]: Connected to new peer: Peer: permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:39:07.717572 18610 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:39:07.717904 18610 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:39:07.721858 18610 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14: Sending DeleteTablet for 3 replicas of tablet a19b8bbaea26464dae7f40a1dabcbe6f
I20260619 06:39:07.722761 18748 tablet_service.cc:1514] Processing DeleteTablet for tablet a19b8bbaea26464dae7f40a1dabcbe6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:07 UTC) from {username='oryx', principal='oryx/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:34834
I20260619 06:39:07.722761 18887 tablet_service.cc:1514] Processing DeleteTablet for tablet a19b8bbaea26464dae7f40a1dabcbe6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:07 UTC) from {username='oryx', principal='oryx/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:58116
I20260619 06:39:07.723037 19199 tablet_replica.cc:330] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f: stopping tablet replica
I20260619 06:39:07.723047 19200 tablet_replica.cc:330] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf: stopping tablet replica
I20260619 06:39:07.723248 19200 raft_consensus.cc:2229] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:39:07.723250 19199 raft_consensus.cc:2229] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:39:07.723490 19199 raft_consensus.cc:2258] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:39:07.723605 19200 raft_consensus.cc:2258] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:39:07.724113 18887 tablet_service.cc:1514] Processing DeleteTablet for tablet a19b8bbaea26464dae7f40a1dabcbe6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:07 UTC) from {username='oryx', principal='oryx/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:58116
I20260619 06:39:07.724438 19026 tablet_service.cc:1514] Processing DeleteTablet for tablet a19b8bbaea26464dae7f40a1dabcbe6f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:07 UTC) from {username='oryx', principal='oryx/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:36400
I20260619 06:39:07.724999 19201 tablet_replica.cc:330] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c: stopping tablet replica
I20260619 06:39:07.725225 19201 raft_consensus.cc:2229] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:39:07.725494 19201 raft_consensus.cc:2258] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:39:07.725483 18611 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44646:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:39:07.726177 18611 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:39:07.726704 19200 ts_tablet_manager.cc:1905] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:39:07.726755 19201 ts_tablet_manager.cc:1905] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:39:07.730780 19199 ts_tablet_manager.cc:1905] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:39:07.733983 19200 ts_tablet_manager.cc:1918] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:39:07.734468 19200 log.cc:1196] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/a19b8bbaea26464dae7f40a1dabcbe6f
I20260619 06:39:07.735047 19200 ts_tablet_manager.cc:1939] T a19b8bbaea26464dae7f40a1dabcbe6f P 150dc1273cb0405982cc0f335011edaf: Deleting consensus metadata
I20260619 06:39:07.735220 18748 tablet_service.cc:1467] Processing CreateTablet for tablet 3e00b9129252454eb291fde830eacd7a (DEFAULT_TABLE table=test-table [id=01eefcb71fea4636b06810210c7aa1d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:39:07.736153 18748 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e00b9129252454eb291fde830eacd7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:07.737421 19201 ts_tablet_manager.cc:1918] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:39:07.737596 19201 log.cc:1196] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/a19b8bbaea26464dae7f40a1dabcbe6f
I20260619 06:39:07.737967 19201 ts_tablet_manager.cc:1939] T a19b8bbaea26464dae7f40a1dabcbe6f P d917ca731d554c789079e077c714966c: Deleting consensus metadata
I20260619 06:39:07.740738 19026 tablet_service.cc:1467] Processing CreateTablet for tablet 3e00b9129252454eb291fde830eacd7a (DEFAULT_TABLE table=test-table [id=01eefcb71fea4636b06810210c7aa1d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:39:07.741181 19026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e00b9129252454eb291fde830eacd7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:07.744263 18596 catalog_manager.cc:4841] TS 150dc1273cb0405982cc0f335011edaf (127.10.192.66:38131): tablet a19b8bbaea26464dae7f40a1dabcbe6f (table test-table [id=e61c24c970a940a0b9f0fdbd3865fb50]) successfully deleted
W20260619 06:39:07.744801 18596 catalog_manager.cc:4808] TS 150dc1273cb0405982cc0f335011edaf (127.10.192.66:38131): delete failed for tablet a19b8bbaea26464dae7f40a1dabcbe6f because the tablet was not found. No further retry: Not found: Tablet not found: a19b8bbaea26464dae7f40a1dabcbe6f
I20260619 06:39:07.744827 18887 tablet_service.cc:1467] Processing CreateTablet for tablet 3e00b9129252454eb291fde830eacd7a (DEFAULT_TABLE table=test-table [id=01eefcb71fea4636b06810210c7aa1d9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:39:07.745275 18887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3e00b9129252454eb291fde830eacd7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:07.748095 18595 catalog_manager.cc:4841] TS d917ca731d554c789079e077c714966c (127.10.192.67:37621): tablet a19b8bbaea26464dae7f40a1dabcbe6f (table test-table [id=e61c24c970a940a0b9f0fdbd3865fb50]) successfully deleted
I20260619 06:39:07.751767 19217 tablet_bootstrap.cc:492] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c: Bootstrap starting.
I20260619 06:39:07.753516 19217 tablet_bootstrap.cc:654] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:07.754207 19218 tablet_bootstrap.cc:492] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f: Bootstrap starting.
I20260619 06:39:07.755577 19216 tablet_bootstrap.cc:492] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf: Bootstrap starting.
I20260619 06:39:07.756060 19218 tablet_bootstrap.cc:654] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:07.756183 19199 ts_tablet_manager.cc:1918] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:39:07.756351 19199 log.cc:1196] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/a19b8bbaea26464dae7f40a1dabcbe6f
I20260619 06:39:07.756860 19199 ts_tablet_manager.cc:1939] T a19b8bbaea26464dae7f40a1dabcbe6f P 39d899187a6f46eda44bcdf2c0de931f: Deleting consensus metadata
I20260619 06:39:07.757489 19216 tablet_bootstrap.cc:654] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:07.757978 18597 catalog_manager.cc:4841] TS 39d899187a6f46eda44bcdf2c0de931f (127.10.192.65:35671): tablet a19b8bbaea26464dae7f40a1dabcbe6f (table test-table [id=e61c24c970a940a0b9f0fdbd3865fb50]) successfully deleted
I20260619 06:39:07.774672 19216 tablet_bootstrap.cc:492] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf: No bootstrap required, opened a new log
I20260619 06:39:07.774863 19216 ts_tablet_manager.cc:1397] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.005s
I20260619 06:39:07.775709 19216 raft_consensus.cc:348] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.776005 19216 raft_consensus.cc:374] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:07.776098 19216 raft_consensus.cc:729] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 150dc1273cb0405982cc0f335011edaf, State: Initialized, Role: FOLLOWER
I20260619 06:39:07.776400 19216 consensus_queue.cc:260] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.777063 19216 ts_tablet_manager.cc:1428] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260619 06:39:07.778944 19217 tablet_bootstrap.cc:492] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c: No bootstrap required, opened a new log
I20260619 06:39:07.778949 19218 tablet_bootstrap.cc:492] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f: No bootstrap required, opened a new log
I20260619 06:39:07.779134 19217 ts_tablet_manager.cc:1397] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.006s
I20260619 06:39:07.779158 19218 ts_tablet_manager.cc:1397] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f: Time spent bootstrapping tablet: real 0.025s user 0.007s sys 0.010s
I20260619 06:39:07.779975 19218 raft_consensus.cc:348] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.779976 19217 raft_consensus.cc:348] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.780231 19218 raft_consensus.cc:374] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:07.780231 19217 raft_consensus.cc:374] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:07.780304 19217 raft_consensus.cc:729] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d917ca731d554c789079e077c714966c, State: Initialized, Role: FOLLOWER
I20260619 06:39:07.780304 19218 raft_consensus.cc:729] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39d899187a6f46eda44bcdf2c0de931f, State: Initialized, Role: FOLLOWER
I20260619 06:39:07.780566 19218 consensus_queue.cc:260] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.781749 19218 ts_tablet_manager.cc:1428] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 06:39:07.782064 19217 consensus_queue.cc:260] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.782599 19217 ts_tablet_manager.cc:1428] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260619 06:39:07.873746 19197 raft_consensus.cc:482] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:39:07.873999 19197 raft_consensus.cc:504] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.874756 19197 leader_election.cc:288] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 150dc1273cb0405982cc0f335011edaf (127.10.192.66:38131), d917ca731d554c789079e077c714966c (127.10.192.67:37621)
I20260619 06:39:07.875353 19046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e00b9129252454eb291fde830eacd7a" candidate_uuid: "39d899187a6f46eda44bcdf2c0de931f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d917ca731d554c789079e077c714966c" is_pre_election: true
I20260619 06:39:07.875411 18912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e00b9129252454eb291fde830eacd7a" candidate_uuid: "39d899187a6f46eda44bcdf2c0de931f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150dc1273cb0405982cc0f335011edaf" is_pre_election: true
I20260619 06:39:07.875685 19046 raft_consensus.cc:2454] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39d899187a6f46eda44bcdf2c0de931f in term 0.
I20260619 06:39:07.875725 18912 raft_consensus.cc:2454] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39d899187a6f46eda44bcdf2c0de931f in term 0.
I20260619 06:39:07.876223 18698 leader_election.cc:302] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 39d899187a6f46eda44bcdf2c0de931f, d917ca731d554c789079e077c714966c; no voters:
I20260619 06:39:07.876533 19197 raft_consensus.cc:2781] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:39:07.876688 19197 raft_consensus.cc:482] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:39:07.876809 19197 raft_consensus.cc:3037] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:07.880805 19197 raft_consensus.cc:504] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.881646 19197 leader_election.cc:288] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [CANDIDATE]: Term 1 election: Requested vote from peers 150dc1273cb0405982cc0f335011edaf (127.10.192.66:38131), d917ca731d554c789079e077c714966c (127.10.192.67:37621)
I20260619 06:39:07.882040 19046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e00b9129252454eb291fde830eacd7a" candidate_uuid: "39d899187a6f46eda44bcdf2c0de931f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d917ca731d554c789079e077c714966c"
I20260619 06:39:07.882277 19046 raft_consensus.cc:3037] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:07.882278 18912 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3e00b9129252454eb291fde830eacd7a" candidate_uuid: "39d899187a6f46eda44bcdf2c0de931f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "150dc1273cb0405982cc0f335011edaf"
I20260619 06:39:07.882529 18912 raft_consensus.cc:3037] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:07.885025 18912 raft_consensus.cc:2454] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d899187a6f46eda44bcdf2c0de931f in term 1.
I20260619 06:39:07.885176 19046 raft_consensus.cc:2454] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39d899187a6f46eda44bcdf2c0de931f in term 1.
I20260619 06:39:07.885560 18699 leader_election.cc:302] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 150dc1273cb0405982cc0f335011edaf, 39d899187a6f46eda44bcdf2c0de931f; no voters:
I20260619 06:39:07.885883 19197 raft_consensus.cc:2781] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:39:07.886330 19197 raft_consensus.cc:686] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [term 1 LEADER]: Becoming Leader. State: Replica: 39d899187a6f46eda44bcdf2c0de931f, State: Running, Role: LEADER
I20260619 06:39:07.886646 19197 consensus_queue.cc:237] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } }
I20260619 06:39:07.889715 18610 catalog_manager.cc:5495] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f reported cstate change: term changed from 0 to 1, leader changed from <none> to 39d899187a6f46eda44bcdf2c0de931f (127.10.192.65). New cstate: current_term: 1 leader_uuid: "39d899187a6f46eda44bcdf2c0de931f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39d899187a6f46eda44bcdf2c0de931f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35671 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 } health_report { overall_health: UNKNOWN } } }
I20260619 06:39:07.929330 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:07.924657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34854 (local address 127.10.192.65:35671)
0619 06:39:07.925161 (+ 504us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:07.925165 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:07.925180 (+ 15us) server_negotiation.cc:407] Connection header received
0619 06:39:07.925229 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:07.925233 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:07.925291 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:07.925373 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:39:07.925708 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.926435 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.927790 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.928200 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.928311 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:07.928726 (+ 415us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:39:07.928825 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:39:07.928905 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:07.929027 (+ 122us) server_negotiation.cc:299] Negotiation successful
0619 06:39:07.929087 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":298,"threads_started":1}
I20260619 06:39:07.941841 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:07.937180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:52249 (local address 127.10.192.65:35671)
0619 06:39:07.937348 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:07.937352 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:07.937766 (+ 414us) server_negotiation.cc:407] Connection header received
0619 06:39:07.937900 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:07.937903 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:07.937961 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:07.938046 (+ 85us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:39:07.938399 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.939081 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.940486 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.940856 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.940957 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:07.941263 (+ 306us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:39:07.941360 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:39:07.941427 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:07.941532 (+ 105us) server_negotiation.cc:299] Negotiation successful
0619 06:39:07.941603 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":5,"server-negotiator.queue_time_us":68}
I20260619 06:39:07.941952 19235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:07.937108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:35671 (local address 127.10.192.65:52249)
0619 06:39:07.937669 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:07.937684 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:07.937792 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:07.938077 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:07.938080 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:07.938088 (+ 8us) client_negotiation.cc:189] Negotiated authn=TOKEN
0619 06:39:07.938287 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:07.938293 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.939191 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.939194 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:07.940358 (+ 1164us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:07.940369 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:07.940986 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:07.940990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:07.941103 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:07.941136 (+ 33us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0619 06:39:07.941455 (+ 319us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0619 06:39:07.941463 (+ 8us) client_negotiation.cc:769] Sending connection context
0619 06:39:07.941521 (+ 58us) client_negotiation.cc:240] Negotiation successful
0619 06:39:07.941639 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"mutex_wait_us":30,"thread_start_us":311,"threads_started":1}
I20260619 06:39:07.949556 18912 raft_consensus.cc:1261] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf [term 1 FOLLOWER]: Refusing update from remote peer 39d899187a6f46eda44bcdf2c0de931f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:39:07.949612 19046 raft_consensus.cc:1261] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c [term 1 FOLLOWER]: Refusing update from remote peer 39d899187a6f46eda44bcdf2c0de931f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:39:07.950145 19197 consensus_queue.cc:1035] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [LEADER]: Connected to new peer: Peer: permanent_uuid: "d917ca731d554c789079e077c714966c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37621 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:39:07.950423 19229 consensus_queue.cc:1035] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [LEADER]: Connected to new peer: Peer: permanent_uuid: "150dc1273cb0405982cc0f335011edaf" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:39:07.998571 18609 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:39:07.998867 18609 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:39:08.002588 18609 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a7b6b2105b224df8b868040c03698e14: Sending DeleteTablet for 3 replicas of tablet 3e00b9129252454eb291fde830eacd7a
I20260619 06:39:08.003736 18887 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e00b9129252454eb291fde830eacd7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:07 UTC) from {username='oryx', principal='oryx/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:58116
I20260619 06:39:08.003865 19026 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e00b9129252454eb291fde830eacd7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:07 UTC) from {username='oryx', principal='oryx/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:36400
I20260619 06:39:08.004071 19200 tablet_replica.cc:330] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf: stopping tablet replica
I20260619 06:39:08.004216 19201 tablet_replica.cc:330] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c: stopping tablet replica
I20260619 06:39:08.004287 19200 raft_consensus.cc:2229] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:39:08.004390 19201 raft_consensus.cc:2229] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:39:08.004513 19200 raft_consensus.cc:2258] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:39:08.004491 18748 tablet_service.cc:1514] Processing DeleteTablet for tablet 3e00b9129252454eb291fde830eacd7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:07 UTC) from {username='oryx', principal='oryx/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:34834
I20260619 06:39:08.004585 19201 raft_consensus.cc:2258] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:39:08.004828 19199 tablet_replica.cc:330] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f: stopping tablet replica
I20260619 06:39:08.005038 19199 raft_consensus.cc:2229] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:39:08.005635 19200 ts_tablet_manager.cc:1905] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:39:08.005679 19199 raft_consensus.cc:2258] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:39:08.007085 19201 ts_tablet_manager.cc:1905] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:39:08.011070 19199 ts_tablet_manager.cc:1905] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:39:08.011109 19200 ts_tablet_manager.cc:1918] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 06:39:08.011247 19200 log.cc:1196] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/3e00b9129252454eb291fde830eacd7a
I20260619 06:39:08.011744 19200 ts_tablet_manager.cc:1939] T 3e00b9129252454eb291fde830eacd7a P 150dc1273cb0405982cc0f335011edaf: Deleting consensus metadata
I20260619 06:39:08.015867 18596 catalog_manager.cc:4841] TS 150dc1273cb0405982cc0f335011edaf (127.10.192.66:38131): tablet 3e00b9129252454eb291fde830eacd7a (table test-table [id=01eefcb71fea4636b06810210c7aa1d9]) successfully deleted
I20260619 06:39:08.017081 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 18682
I20260619 06:39:08.019063 19199 ts_tablet_manager.cc:1918] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 06:39:08.019224 19199 log.cc:1196] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/3e00b9129252454eb291fde830eacd7a
I20260619 06:39:08.019745 19199 ts_tablet_manager.cc:1939] T 3e00b9129252454eb291fde830eacd7a P 39d899187a6f46eda44bcdf2c0de931f: Deleting consensus metadata
I20260619 06:39:08.019884 19201 ts_tablet_manager.cc:1918] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260619 06:39:08.020016 19201 log.cc:1196] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/3e00b9129252454eb291fde830eacd7a
I20260619 06:39:08.020448 19201 ts_tablet_manager.cc:1939] T 3e00b9129252454eb291fde830eacd7a P d917ca731d554c789079e077c714966c: Deleting consensus metadata
I20260619 06:39:08.021153 18597 catalog_manager.cc:4841] TS 39d899187a6f46eda44bcdf2c0de931f (127.10.192.65:35671): tablet 3e00b9129252454eb291fde830eacd7a (table test-table [id=01eefcb71fea4636b06810210c7aa1d9]) successfully deleted
I20260619 06:39:08.021499 18595 catalog_manager.cc:4841] TS d917ca731d554c789079e077c714966c (127.10.192.67:37621): tablet 3e00b9129252454eb291fde830eacd7a (table test-table [id=01eefcb71fea4636b06810210c7aa1d9]) successfully deleted
Jun 19 06:39:08 dist-test-slave-7lz4 krb5kdc[18566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.192.65@KRBTEST.COM
I20260619 06:39:08.041975 19232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:08.020351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34856 (local address 127.10.192.65:35671)
0619 06:39:08.020946 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:08.020952 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:08.027129 (+ 6177us) server_negotiation.cc:407] Connection header received
0619 06:39:08.027354 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:08.027364 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:08.027443 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:08.027572 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:08.028902 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:08.029694 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:08.030968 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:08.031404 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:08.031559 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:08.035695 (+ 4136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:08.035715 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:08.035731 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:08.035776 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:08.038889 (+ 3113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:08.039681 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:08.039691 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:08.039704 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:08.039868 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:08.040275 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:08.040282 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:08.040288 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:08.040741 (+ 453us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:08.041106 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:08.041367 (+ 261us) server_negotiation.cc:299] Negotiation successful
0619 06:39:08.041596 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":433}
I20260619 06:39:08.042626 18813 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:08.176151 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 18682
I20260619 06:39:08.200038 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 18822
Jun 19 06:39:08 dist-test-slave-7lz4 krb5kdc[18566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.192.66@KRBTEST.COM
I20260619 06:39:08.215879 19175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:08.200735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58148 (local address 127.10.192.66:38131)
0619 06:39:08.200982 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:08.200988 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:08.201007 (+ 19us) server_negotiation.cc:407] Connection header received
0619 06:39:08.201113 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:08.201123 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:08.201184 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:08.201289 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:08.202516 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:08.203218 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:08.204600 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:08.205047 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:08.205193 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:08.209678 (+ 4485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:08.209701 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:08.209718 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:08.209775 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:08.213046 (+ 3271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:08.213723 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:08.213731 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:08.213733 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:08.213860 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:08.214295 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:08.214300 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:08.214302 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:08.214733 (+ 431us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:08.215017 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:08.215286 (+ 269us) server_negotiation.cc:299] Negotiation successful
0619 06:39:08.215480 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260619 06:39:08.216668 18952 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:08.342959 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 18822
I20260619 06:39:08.365615 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 18961
Jun 19 06:39:08 dist-test-slave-7lz4 krb5kdc[18566](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851147, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.10.192.67@KRBTEST.COM
I20260619 06:39:08.381661 19244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:08.366520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36420 (local address 127.10.192.67:37621)
0619 06:39:08.367015 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:08.367020 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:08.367037 (+ 17us) server_negotiation.cc:407] Connection header received
0619 06:39:08.367093 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:08.367097 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:08.367160 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:08.367251 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:08.368753 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:08.369543 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:08.370843 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:08.371243 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:08.371346 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:08.375911 (+ 4565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:08.375927 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:08.375944 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:08.375990 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:08.378967 (+ 2977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:08.379677 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:08.379690 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:08.379695 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:08.379891 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:08.380236 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:08.380239 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:08.380241 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:08.380588 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:08.380793 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:08.381021 (+ 228us) server_negotiation.cc:299] Negotiation successful
0619 06:39:08.381232 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":392,"thread_start_us":271,"threads_started":1}
I20260619 06:39:08.382440 19091 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:08.504992 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 18961
I20260619 06:39:08.526751 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 18579
I20260619 06:39:08.528067 18651 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:08.644598 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 18579
2026-06-19T06:39:08Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (6365 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:39:08 dist-test-slave-7lz4 krb5kdc[19249](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:39:08 dist-test-slave-7lz4 krb5kdc[19249](info): set up 2 sockets
Jun 19 06:39:08 dist-test-slave-7lz4 krb5kdc[19249](info): commencing operation
krb5kdc: starting...
W20260619 06:39:09.756732 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.067s user 0.004s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:39:09 dist-test-slave-7lz4 krb5kdc[19249](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851149, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:39:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:39:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:39:09.983484 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:37769
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:36241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:37769
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:39:10.312054 19262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:10.312450 19262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:10.312613 19262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:10.320020 19262 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:39:10.320194 19262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:10.320308 19262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:10.320412 19262 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:39:10.320504 19262 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:39:10.330623 19262 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:36241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:37769
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:37769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:10.332067 19262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:10.333482 19262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:10.345623 19267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:10.345621 19268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:10.345669 19270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:10.346835 19262 server_base.cc:1034] running on GCE node
I20260619 06:39:10.347764 19262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:10.349236 19262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:10.350478 19262 hybrid_clock.cc:648] HybridClock initialized: now 1781851150350424 us; error 48 us; skew 500 ppm
I20260619 06:39:10.350837 19262 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-06-19T06:39:10Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1776 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:39:10 dist-test-slave-7lz4 krb5kdc[19276](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:39:10 dist-test-slave-7lz4 krb5kdc[19276](info): set up 2 sockets
Jun 19 06:39:10 dist-test-slave-7lz4 krb5kdc[19276](info): commencing operation
krb5kdc: starting...
W20260619 06:39:11.524686 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.058s user 0.000s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:39:11 dist-test-slave-7lz4 krb5kdc[19276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:39:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:39:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:39:11.757879 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:39589
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:45495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:39589
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:39:12.089249 19289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:12.089550 19289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:12.089721 19289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:12.097170 19289 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:39:12.097285 19289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:12.097407 19289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:12.097507 19289 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:39:12.097584 19289 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:39:12.107785 19289 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:45495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:39589
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:39589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:12.109215 19289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:12.110570 19289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:12.122859 19294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:12.122973 19295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:12.122973 19297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:12.123874 19289 server_base.cc:1034] running on GCE node
I20260619 06:39:12.124657 19289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:12.126206 19289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:12.127429 19289 hybrid_clock.cc:648] HybridClock initialized: now 1781851152127363 us; error 49 us; skew 500 ppm
I20260619 06:39:12.127816 19289 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:39:12 dist-test-slave-7lz4 krb5kdc[19276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851152, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:39:12.135733 19289 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:39:12.137367 19289 webserver.cc:460] Webserver started at http://127.10.192.126:40285/ using document root <none> and password file <none>
I20260619 06:39:12.138147 19289 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:12.138283 19289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:12.138613 19289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:12.141709 19289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "9ef89352278a48f6b8fa8473d7143121"
format_stamp: "Formatted at 2026-06-19 06:39:12 on dist-test-slave-7lz4"
server_key: "f43ddbaf7ab9df3902ebcb1eecf9ae01"
server_key_iv: "d6272d03ac12ae6d40234c158f6de945"
server_key_version: "encryptionkey@0"
I20260619 06:39:12.142504 19289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "9ef89352278a48f6b8fa8473d7143121"
format_stamp: "Formatted at 2026-06-19 06:39:12 on dist-test-slave-7lz4"
server_key: "f43ddbaf7ab9df3902ebcb1eecf9ae01"
server_key_iv: "d6272d03ac12ae6d40234c158f6de945"
server_key_version: "encryptionkey@0"
I20260619 06:39:12.148443 19289 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260619 06:39:12.152056 19304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:12.153420 19289 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:39:12.153615 19289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "9ef89352278a48f6b8fa8473d7143121"
format_stamp: "Formatted at 2026-06-19 06:39:12 on dist-test-slave-7lz4"
server_key: "f43ddbaf7ab9df3902ebcb1eecf9ae01"
server_key_iv: "d6272d03ac12ae6d40234c158f6de945"
server_key_version: "encryptionkey@0"
I20260619 06:39:12.153831 19289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:12.186218 19289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:12.190503 19289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:12.190810 19289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:12.209663 19289 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:39589
I20260619 06:39:12.209681 19355 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:39589 every 8 connection(s)
I20260619 06:39:12.211117 19289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:39:12.215034 19356 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:12.220837 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 19289
I20260619 06:39:12.221062 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:39:12.221855 11009 external_mini_cluster.cc:1428] Setting key de17f1855093f51328c1e134c6d3842b
I20260619 06:39:12.226852 19356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121: Bootstrap starting.
I20260619 06:39:12.230517 19356 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:12.231827 19356 log.cc:824] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121: Log is configured to *not* fsync() on all Append() calls
I20260619 06:39:12.235163 19356 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121: No bootstrap required, opened a new log
Jun 19 06:39:12 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:39:12.243525 19356 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ef89352278a48f6b8fa8473d7143121" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39589 } }
I20260619 06:39:12.243968 19356 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:12.244107 19356 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ef89352278a48f6b8fa8473d7143121, State: Initialized, Role: FOLLOWER
I20260619 06:39:12.244760 19356 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ef89352278a48f6b8fa8473d7143121" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39589 } }
I20260619 06:39:12.245018 19356 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:39:12.245170 19356 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:39:12.245357 19356 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:12.246183 19359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:12.224254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41972 (local address 127.10.192.126:39589)
0619 06:39:12.225093 (+ 839us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:12.225105 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:12.225145 (+ 40us) server_negotiation.cc:407] Connection header received
0619 06:39:12.226790 (+ 1645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:12.226812 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:12.227281 (+ 469us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:12.227605 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:12.229440 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:12.230778 (+ 1338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:12.232604 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:12.233537 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:12.233666 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:12.238330 (+ 4664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:12.238338 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:12.238353 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:12.238393 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:12.241600 (+ 3207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:12.242328 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:12.242335 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:12.242342 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:12.242531 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:12.242924 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:12.242929 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:12.242931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:12.243487 (+ 556us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:12.243808 (+ 321us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:12.244301 (+ 493us) server_negotiation.cc:299] Negotiation successful
0619 06:39:12.244871 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":411,"threads_started":1}
I20260619 06:39:12.248256 19356 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ef89352278a48f6b8fa8473d7143121" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39589 } }
I20260619 06:39:12.248761 19356 leader_election.cc:302] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ef89352278a48f6b8fa8473d7143121; no voters:
I20260619 06:39:12.249433 19356 leader_election.cc:288] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:39:12.249606 19361 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:39:12.250284 19361 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [term 1 LEADER]: Becoming Leader. State: Replica: 9ef89352278a48f6b8fa8473d7143121, State: Running, Role: LEADER
I20260619 06:39:12.251091 19361 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ef89352278a48f6b8fa8473d7143121" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39589 } }
I20260619 06:39:12.251787 19356 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:39:12.253970 19362 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9ef89352278a48f6b8fa8473d7143121" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ef89352278a48f6b8fa8473d7143121" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39589 } } }
I20260619 06:39:12.253985 19363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ef89352278a48f6b8fa8473d7143121. Latest consensus state: current_term: 1 leader_uuid: "9ef89352278a48f6b8fa8473d7143121" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ef89352278a48f6b8fa8473d7143121" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39589 } } }
I20260619 06:39:12.254454 19362 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [sys.catalog]: This master's current role is: LEADER
I20260619 06:39:12.254570 19363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [sys.catalog]: This master's current role is: LEADER
I20260619 06:39:12.256539 19366 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:39:12.261895 19366 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:39:12.272363 19366 catalog_manager.cc:1347] Generated new cluster ID: d2ea7db4cb144cf28ccee6e9883599b3
I20260619 06:39:12.272498 19366 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:39:12.307309 19366 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:39:12.309381 19366 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:39:12.324254 19366 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121: Generated new TSK 0
I20260619 06:39:12.325248 19366 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
I20260619 06:39:12.393455 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39589
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:45495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:39:12.737550 19382 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:12.737891 19382 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:12.738083 19382 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:12.745543 19382 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:12.745661 19382 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:12.745877 19382 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:39:12.756470 19382 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:45495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39589
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:12.757864 19382 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:12.759286 19382 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:12.772929 19387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:12.772861 19388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:12.773154 19390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:12.774408 19382 server_base.cc:1034] running on GCE node
I20260619 06:39:12.775068 19382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:12.776058 19382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:12.777276 19382 hybrid_clock.cc:648] HybridClock initialized: now 1781851152777217 us; error 59 us; skew 500 ppm
I20260619 06:39:12.777604 19382 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:39:12 dist-test-slave-7lz4 krb5kdc[19276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851152, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:39:12.780720 19382 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:39:12.782196 19382 webserver.cc:460] Webserver started at http://127.10.192.65:37395/ using document root <none> and password file <none>
I20260619 06:39:12.782908 19382 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:12.783058 19382 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:12.783368 19382 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:12.786422 19382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "274d32622b644b9ab48da4a8a48f0fd9"
format_stamp: "Formatted at 2026-06-19 06:39:12 on dist-test-slave-7lz4"
server_key: "64a38ebb66965f43dc5df0ff25ae425f"
server_key_iv: "a17e1e4e611864684e42cb85a7b98616"
server_key_version: "encryptionkey@0"
I20260619 06:39:12.787230 19382 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "274d32622b644b9ab48da4a8a48f0fd9"
format_stamp: "Formatted at 2026-06-19 06:39:12 on dist-test-slave-7lz4"
server_key: "64a38ebb66965f43dc5df0ff25ae425f"
server_key_iv: "a17e1e4e611864684e42cb85a7b98616"
server_key_version: "encryptionkey@0"
I20260619 06:39:12.792577 19382 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260619 06:39:12.796126 19397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:12.797531 19382 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260619 06:39:12.797715 19382 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "274d32622b644b9ab48da4a8a48f0fd9"
format_stamp: "Formatted at 2026-06-19 06:39:12 on dist-test-slave-7lz4"
server_key: "64a38ebb66965f43dc5df0ff25ae425f"
server_key_iv: "a17e1e4e611864684e42cb85a7b98616"
server_key_version: "encryptionkey@0"
I20260619 06:39:12.797925 19382 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:12.826017 19382 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:12.830698 19382 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:12.830955 19382 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:12.831924 19382 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:39:12.833263 19382 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:39:12.833335 19382 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:12.833418 19382 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:39:12.833472 19382 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:12.867141 19382 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:33683
I20260619 06:39:12.867185 19509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:33683 every 8 connection(s)
I20260619 06:39:12.868510 19382 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:39:12.869284 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 19382
I20260619 06:39:12.869509 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:39:12.870242 11009 external_mini_cluster.cc:1428] Setting key 4e89a4914cbc7569f677dad50f846875
Jun 19 06:39:12 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851152, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:39:12.897622 19513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:12.872066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.65:45147)
0619 06:39:12.872996 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:12.873057 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:12.875824 (+ 2767us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:12.876657 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:12.876672 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:12.877507 (+ 835us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:12.878409 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:12.878437 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:12.879575 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:12.879584 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:12.881255 (+ 1671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:12.881268 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:12.882517 (+ 1249us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:12.882521 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:12.882718 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:12.883464 (+ 746us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:12.883487 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:12.885784 (+ 2297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:39:12.891275 (+ 5491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:12.891289 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:12.891313 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:12.892320 (+ 1007us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:12.892837 (+ 517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:12.892865 (+ 28us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:12.892872 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:12.893248 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:12.894188 (+ 940us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:39:12.894200 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:39:12.894781 (+ 581us) client_negotiation.cc:769] Sending connection context
0619 06:39:12.895163 (+ 382us) client_negotiation.cc:240] Negotiation successful
0619 06:39:12.895890 (+ 727us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"thread_start_us":348,"threads_started":1}
WARNING: no policy specified for kudu/127.10.192.66@KRBTEST.COM; defaulting to no policy
I20260619 06:39:12.899459 19512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:12.871330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:45147 (local address 127.10.192.126:39589)
0619 06:39:12.871849 (+ 519us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:12.871854 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:12.873194 (+ 1340us) server_negotiation.cc:407] Connection header received
0619 06:39:12.876165 (+ 2971us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:12.876171 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:12.876258 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:12.876359 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:12.878602 (+ 2243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:12.879405 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:12.881454 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:12.882290 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:12.882448 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:12.886030 (+ 3582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:12.886040 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:12.886049 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:12.886099 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:12.891070 (+ 4971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:12.892512 (+ 1442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:12.892520 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:12.892525 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:12.892698 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:12.893519 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:12.893528 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:12.893535 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:12.894002 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:12.894196 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:12.898457 (+ 4261us) server_negotiation.cc:299] Negotiation successful
0619 06:39:12.898941 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":304,"threads_started":1}
I20260619 06:39:12.901026 19510 heartbeater.cc:347] Connected to a master server at 127.10.192.126:39589
I20260619 06:39:12.901422 19510 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.66@KRBTEST.COM" created.
I20260619 06:39:12.902390 19510 heartbeater.cc:511] Master 127.10.192.126:39589 requested a full tablet report, sending...
I20260619 06:39:12.904878 19321 ts_manager.cc:194] Registered new tserver with Master: 274d32622b644b9ab48da4a8a48f0fd9 (127.10.192.65:33683)
I20260619 06:39:12.906862 19321 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:45147
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
I20260619 06:39:12.937042 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39589
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:45495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:39:13.269096 19516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:13.269387 19516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:13.269488 19516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:13.276711 19516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:13.276830 19516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:13.276943 19516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:39:13.286919 19516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:45495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39589
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:13.288311 19516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:13.289585 19516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:13.303431 19521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:13.303329 19522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:13.303347 19524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:13.304342 19516 server_base.cc:1034] running on GCE node
I20260619 06:39:13.305018 19516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:13.306041 19516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:13.307284 19516 hybrid_clock.cc:648] HybridClock initialized: now 1781851153307291 us; error 103 us; skew 500 ppm
I20260619 06:39:13.307679 19516 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:39:13 dist-test-slave-7lz4 krb5kdc[19276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851153, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:39:13.311095 19516 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:39:13.312808 19516 webserver.cc:460] Webserver started at http://127.10.192.66:37727/ using document root <none> and password file <none>
I20260619 06:39:13.313603 19516 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:13.313756 19516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:13.314101 19516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:13.317405 19516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "6b20b7558642446bb1cd0f330490ff66"
format_stamp: "Formatted at 2026-06-19 06:39:13 on dist-test-slave-7lz4"
server_key: "9d0adbf4badeab9952cae3c0ca49fb8c"
server_key_iv: "993ea03d1871404e2d8bb1826c2ef8f6"
server_key_version: "encryptionkey@0"
I20260619 06:39:13.318300 19516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "6b20b7558642446bb1cd0f330490ff66"
format_stamp: "Formatted at 2026-06-19 06:39:13 on dist-test-slave-7lz4"
server_key: "9d0adbf4badeab9952cae3c0ca49fb8c"
server_key_iv: "993ea03d1871404e2d8bb1826c2ef8f6"
server_key_version: "encryptionkey@0"
I20260619 06:39:13.323941 19516 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 06:39:13.327483 19531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:13.329000 19516 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:39:13.329142 19516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "6b20b7558642446bb1cd0f330490ff66"
format_stamp: "Formatted at 2026-06-19 06:39:13 on dist-test-slave-7lz4"
server_key: "9d0adbf4badeab9952cae3c0ca49fb8c"
server_key_iv: "993ea03d1871404e2d8bb1826c2ef8f6"
server_key_version: "encryptionkey@0"
I20260619 06:39:13.329326 19516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:13.353030 19516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:13.357661 19516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:13.358022 19516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:13.359143 19516 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:39:13.360706 19516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:39:13.360787 19516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:13.360896 19516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:39:13.360945 19516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:13.395864 19516 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:38451
I20260619 06:39:13.395885 19643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:38451 every 8 connection(s)
I20260619 06:39:13.397269 19516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:39:13.400193 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 19516
I20260619 06:39:13.400400 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:39:13.400853 11009 external_mini_cluster.cc:1428] Setting key b720f1de90f481b378e0c9eae063d1a6
Jun 19 06:39:13 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851153, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:39:13.420781 19512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:13.400019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:40977 (local address 127.10.192.126:39589)
0619 06:39:13.400255 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:13.400263 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:13.401888 (+ 1625us) server_negotiation.cc:407] Connection header received
0619 06:39:13.404262 (+ 2374us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:13.404271 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:13.404366 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:13.404491 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:13.406109 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:13.407246 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:13.409024 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:13.409547 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:13.409645 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:13.414181 (+ 4536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:13.414186 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:13.414190 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:13.414227 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:13.417009 (+ 2782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:13.418101 (+ 1092us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:13.418106 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:13.418108 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:13.418244 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:13.418851 (+ 607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:13.418859 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:13.418863 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:13.419150 (+ 287us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:13.419269 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:13.420336 (+ 1067us) server_negotiation.cc:299] Negotiation successful
0619 06:39:13.420525 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260619 06:39:13.422487 19646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:13.400710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.66:40977)
0619 06:39:13.401697 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:13.401755 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:13.403967 (+ 2212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:13.404714 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:13.404723 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:13.405298 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:13.405920 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:13.405938 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:13.407392 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:13.407396 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:13.408866 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:13.408879 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:13.409800 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:13.409808 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:13.410181 (+ 373us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:13.411055 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:13.411080 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:13.413873 (+ 2793us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:39:13.417174 (+ 3301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:13.417187 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:13.417210 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:13.417919 (+ 709us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:13.418370 (+ 451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:13.418378 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:13.418385 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:13.418661 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:13.419293 (+ 632us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:39:13.419305 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:39:13.419860 (+ 555us) client_negotiation.cc:769] Sending connection context
0619 06:39:13.420233 (+ 373us) client_negotiation.cc:240] Negotiation successful
0619 06:39:13.420885 (+ 652us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":598,"thread_start_us":384,"threads_started":1}
WARNING: no policy specified for kudu/127.10.192.67@KRBTEST.COM; defaulting to no policy
I20260619 06:39:13.424253 19644 heartbeater.cc:347] Connected to a master server at 127.10.192.126:39589
I20260619 06:39:13.424602 19644 heartbeater.cc:464] Registering TS with master...
I20260619 06:39:13.425333 19644 heartbeater.cc:511] Master 127.10.192.126:39589 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.67@KRBTEST.COM" created.
I20260619 06:39:13.426899 19321 ts_manager.cc:194] Registered new tserver with Master: 6b20b7558642446bb1cd0f330490ff66 (127.10.192.66:38451)
I20260619 06:39:13.427803 19321 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:40977
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
I20260619 06:39:13.452483 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39589
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:45495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:39:13.779996 19649 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:13.780290 19649 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:13.780458 19649 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:13.788012 19649 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:13.788129 19649 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:13.788329 19649 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:39:13.798372 19649 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:45495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39589
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:13.799795 19649 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:13.801178 19649 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:13.814816 19654 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:13.814846 19657 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:13.814925 19655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:13.815851 19649 server_base.cc:1034] running on GCE node
I20260619 06:39:13.816466 19649 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:13.817414 19649 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:13.818625 19649 hybrid_clock.cc:648] HybridClock initialized: now 1781851153818583 us; error 30 us; skew 500 ppm
I20260619 06:39:13.818917 19649 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:39:13 dist-test-slave-7lz4 krb5kdc[19276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851153, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:39:13.822080 19649 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:39:13.823618 19649 webserver.cc:460] Webserver started at http://127.10.192.67:35229/ using document root <none> and password file <none>
I20260619 06:39:13.824466 19649 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:13.824566 19649 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:13.824820 19649 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:13.827808 19649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "8d09f662912a4272a3d8fc65a8afc9f7"
format_stamp: "Formatted at 2026-06-19 06:39:13 on dist-test-slave-7lz4"
server_key: "5b83dfb76f4b537b41fa8561221faae1"
server_key_iv: "5c3734735b9c7f5f4ee950f01b414d3a"
server_key_version: "encryptionkey@0"
I20260619 06:39:13.828567 19649 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "8d09f662912a4272a3d8fc65a8afc9f7"
format_stamp: "Formatted at 2026-06-19 06:39:13 on dist-test-slave-7lz4"
server_key: "5b83dfb76f4b537b41fa8561221faae1"
server_key_iv: "5c3734735b9c7f5f4ee950f01b414d3a"
server_key_version: "encryptionkey@0"
I20260619 06:39:13.833854 19649 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 06:39:13.837332 19664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:13.838685 19649 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 06:39:13.838871 19649 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "8d09f662912a4272a3d8fc65a8afc9f7"
format_stamp: "Formatted at 2026-06-19 06:39:13 on dist-test-slave-7lz4"
server_key: "5b83dfb76f4b537b41fa8561221faae1"
server_key_iv: "5c3734735b9c7f5f4ee950f01b414d3a"
server_key_version: "encryptionkey@0"
I20260619 06:39:13.839075 19649 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:13.863065 19649 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:13.867694 19649 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:13.868031 19649 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:13.869189 19649 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:39:13.870931 19649 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:39:13.871027 19649 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:13.871135 19649 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:39:13.871189 19649 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:13.905652 19649 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:34805
I20260619 06:39:13.905704 19776 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:34805 every 8 connection(s)
I20260619 06:39:13.907001 19649 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:39:13.910884 19510 heartbeater.cc:503] Master 127.10.192.126:39589 was elected leader, sending a full tablet report...
I20260619 06:39:13.915122 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 19649
I20260619 06:39:13.915318 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:39:13.915791 11009 external_mini_cluster.cc:1428] Setting key 71a9f59d456179516bd0af4b083580cb
Jun 19 06:39:13 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851153, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:39:13.927181 19512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:13.909571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:45569 (local address 127.10.192.126:39589)
0619 06:39:13.909745 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:13.909750 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:13.911130 (+ 1380us) server_negotiation.cc:407] Connection header received
0619 06:39:13.913253 (+ 2123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:13.913257 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:13.913321 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:13.913410 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:13.915055 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:13.916022 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:13.917953 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:13.918375 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:13.918523 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:13.922132 (+ 3609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:13.922137 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:13.922140 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:13.922172 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:13.924628 (+ 2456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:13.925301 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:13.925304 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:13.925307 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:13.925435 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:13.925787 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:13.925790 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:13.925792 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:13.926036 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:13.926145 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:13.926770 (+ 625us) server_negotiation.cc:299] Negotiation successful
0619 06:39:13.926930 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260619 06:39:13.928333 19779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:13.910062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.67:45569)
0619 06:39:13.910844 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:13.910903 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:13.913006 (+ 2103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:13.913677 (+ 671us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:13.913686 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:13.914189 (+ 503us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:13.914878 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:13.914906 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:13.916182 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:13.916187 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:13.917810 (+ 1623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:13.917826 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:13.918615 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:13.918624 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:13.918881 (+ 257us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:13.919586 (+ 705us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:13.919608 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:13.921925 (+ 2317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:39:13.924754 (+ 2829us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:13.924761 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:13.924775 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:13.925203 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:13.925525 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:13.925528 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:13.925530 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:13.925698 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:13.926146 (+ 448us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:39:13.926151 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:39:13.926458 (+ 307us) client_negotiation.cc:769] Sending connection context
0619 06:39:13.926686 (+ 228us) client_negotiation.cc:240] Negotiation successful
0619 06:39:13.927080 (+ 394us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":480,"thread_start_us":269,"threads_started":1}
I20260619 06:39:13.930168 19777 heartbeater.cc:347] Connected to a master server at 127.10.192.126:39589
I20260619 06:39:13.930534 19777 heartbeater.cc:464] Registering TS with master...
I20260619 06:39:13.931486 19777 heartbeater.cc:511] Master 127.10.192.126:39589 requested a full tablet report, sending...
I20260619 06:39:13.932890 19321 ts_manager.cc:194] Registered new tserver with Master: 8d09f662912a4272a3d8fc65a8afc9f7 (127.10.192.67:34805)
I20260619 06:39:13.933821 19321 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:45569
I20260619 06:39:13.944187 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.65.keytab.
Entry for principal oryx/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.65.keytab.
WARNING: no policy specified for oryx/127.10.192.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.192.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.66.keytab.
Entry for principal oryx/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.66.keytab.
WARNING: no policy specified for oryx/127.10.192.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.10.192.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.67.keytab.
Entry for principal oryx/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.67.keytab.
I20260619 06:39:14.087441 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 19382
Jun 19 06:39:14 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:39:14.104630 19787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:14.088872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38472 (local address 127.10.192.65:33683)
0619 06:39:14.089514 (+ 642us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:14.089521 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:14.089549 (+ 28us) server_negotiation.cc:407] Connection header received
0619 06:39:14.089610 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:14.089616 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:14.089842 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:14.089982 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:14.091248 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:14.092350 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:14.093601 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:14.094172 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:14.094268 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:14.098345 (+ 4077us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:14.098357 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:14.098372 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:14.098410 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:14.101731 (+ 3321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:14.102454 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:14.102461 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:14.102464 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:14.102653 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:14.103056 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:14.103059 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:14.103062 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:14.103398 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:14.103706 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:14.104011 (+ 305us) server_negotiation.cc:299] Negotiation successful
0619 06:39:14.104215 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":331,"threads_started":1}
I20260619 06:39:14.106110 19505 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:14.189754 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 19382
I20260619 06:39:14.206802 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 19516
Jun 19 06:39:14 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.66@KRBTEST.COM
I20260619 06:39:14.223557 19789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:14.207770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53048 (local address 127.10.192.66:38451)
0619 06:39:14.208281 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:14.208288 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:14.208314 (+ 26us) server_negotiation.cc:407] Connection header received
0619 06:39:14.208373 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:14.208378 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:14.208611 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:14.208737 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:14.210053 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:14.211678 (+ 1625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:14.212972 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:14.213806 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:14.213954 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:14.218315 (+ 4361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:14.218326 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:14.218341 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:14.218385 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:14.221078 (+ 2693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:14.221703 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:14.221711 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:14.221713 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:14.221837 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:14.222165 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:14.222168 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:14.222170 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:14.222499 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:14.222727 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:14.223075 (+ 348us) server_negotiation.cc:299] Negotiation successful
0619 06:39:14.223275 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":258,"threads_started":1}
I20260619 06:39:14.225090 19639 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:14.309293 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 19516
I20260619 06:39:14.325028 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 19649
Jun 19 06:39:14 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851151, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.67@KRBTEST.COM
I20260619 06:39:14.342204 19791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:14.326145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47900 (local address 127.10.192.67:34805)
0619 06:39:14.326798 (+ 653us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:14.326805 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:14.326834 (+ 29us) server_negotiation.cc:407] Connection header received
0619 06:39:14.326894 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:14.326900 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:14.327124 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:14.327248 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:14.328801 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:14.329794 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:14.331063 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:14.331600 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:14.331762 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:14.336229 (+ 4467us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:14.336241 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:14.336256 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:14.336293 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:14.339235 (+ 2942us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:14.340109 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:14.340117 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:14.340119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:14.340248 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:14.340730 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:14.340735 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:14.340737 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:14.341108 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:14.341343 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:14.341589 (+ 246us) server_negotiation.cc:299] Negotiation successful
0619 06:39:14.341787 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":512,"thread_start_us":361,"threads_started":1}
I20260619 06:39:14.343549 19772 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:14.428409 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 19649
I20260619 06:39:14.444101 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 19289
I20260619 06:39:14.445324 19351 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:14.548425 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 19289
I20260619 06:39:14.569665 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:39589
--webserver_interface=127.10.192.126
--webserver_port=40285
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:45495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:39589
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:39:14.903944 19794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:14.904340 19794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:14.904505 19794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:14.912027 19794 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:39:14.912184 19794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:14.912294 19794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:14.912403 19794 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:39:14.912519 19794 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:39:14.922765 19794 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:45495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:39589
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:39589
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=40285
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:14.924247 19794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:14.925601 19794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:14.937878 19802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:14.938004 19799 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:14.938000 19800 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:14.939030 19794 server_base.cc:1034] running on GCE node
I20260619 06:39:14.939949 19794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:14.941402 19794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:14.942644 19794 hybrid_clock.cc:648] HybridClock initialized: now 1781851154942571 us; error 65 us; skew 500 ppm
I20260619 06:39:14.943029 19794 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:39:14 dist-test-slave-7lz4 krb5kdc[19276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851154, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:39:14.946338 19794 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:39:14.948010 19794 webserver.cc:460] Webserver started at http://127.10.192.126:40285/ using document root <none> and password file <none>
I20260619 06:39:14.948738 19794 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:14.948900 19794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:14.954468 19794 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260619 06:39:14.957458 19809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:14.958819 19794 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 06:39:14.959010 19794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "9ef89352278a48f6b8fa8473d7143121"
format_stamp: "Formatted at 2026-06-19 06:39:12 on dist-test-slave-7lz4"
server_key: "f43ddbaf7ab9df3902ebcb1eecf9ae01"
server_key_iv: "d6272d03ac12ae6d40234c158f6de945"
server_key_version: "encryptionkey@0"
I20260619 06:39:14.960067 19794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:14.982695 19794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:14.987344 19794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:14.987684 19794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:15.007313 19794 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:39589
I20260619 06:39:15.007331 19860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:39589 every 8 connection(s)
I20260619 06:39:15.009013 19794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:39:15.012173 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 19794
I20260619 06:39:15.012966 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:33683
--local_ip_for_outbound_sockets=127.10.192.65
--tserver_master_addrs=127.10.192.126:39589
--webserver_port=37395
--webserver_interface=127.10.192.65
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:45495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.192.65
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.65.keytab with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:39:15.016461 19861 sys_catalog.cc:263] Verifying existing consensus state
I20260619 06:39:15.019819 19861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121: Bootstrap starting.
I20260619 06:39:15.039155 19861 log.cc:824] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121: Log is configured to *not* fsync() on all Append() calls
I20260619 06:39:15.048240 19861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 06:39:15.048784 19861 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121: Bootstrap complete.
I20260619 06:39:15.057965 19861 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ef89352278a48f6b8fa8473d7143121" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39589 } }
I20260619 06:39:15.058806 19861 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9ef89352278a48f6b8fa8473d7143121, State: Initialized, Role: FOLLOWER
I20260619 06:39:15.059466 19861 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ef89352278a48f6b8fa8473d7143121" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39589 } }
I20260619 06:39:15.059726 19861 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:39:15.059857 19861 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:39:15.060042 19861 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [term 1 FOLLOWER]: Advancing to term 2
I20260619 06:39:15.064677 19861 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ef89352278a48f6b8fa8473d7143121" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39589 } }
I20260619 06:39:15.065217 19861 leader_election.cc:302] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9ef89352278a48f6b8fa8473d7143121; no voters:
I20260619 06:39:15.065816 19861 leader_election.cc:288] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260619 06:39:15.066017 19865 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 06:39:15.067211 19865 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [term 2 LEADER]: Becoming Leader. State: Replica: 9ef89352278a48f6b8fa8473d7143121, State: Running, Role: LEADER
I20260619 06:39:15.067898 19865 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ef89352278a48f6b8fa8473d7143121" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39589 } }
I20260619 06:39:15.068102 19861 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:39:15.070320 19866 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "9ef89352278a48f6b8fa8473d7143121" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ef89352278a48f6b8fa8473d7143121" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39589 } } }
I20260619 06:39:15.070668 19866 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [sys.catalog]: This master's current role is: LEADER
I20260619 06:39:15.072886 19867 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9ef89352278a48f6b8fa8473d7143121. Latest consensus state: current_term: 2 leader_uuid: "9ef89352278a48f6b8fa8473d7143121" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9ef89352278a48f6b8fa8473d7143121" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39589 } } }
I20260619 06:39:15.073216 19867 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121 [sys.catalog]: This master's current role is: LEADER
I20260619 06:39:15.078994 19870 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:39:15.084824 19870 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:39:15.086259 19870 catalog_manager.cc:1259] Loaded cluster ID: d2ea7db4cb144cf28ccee6e9883599b3
I20260619 06:39:15.086377 19870 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:39:15.090332 19870 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:39:15.091774 19870 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 9ef89352278a48f6b8fa8473d7143121: Loaded TSK: 0
I20260619 06:39:15.093413 19870 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260619 06:39:15.354545 19863 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:15.354832 19863 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:15.354979 19863 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:15.362588 19863 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:15.362712 19863 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:15.362887 19863 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:39:15.373340 19863 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:45495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.65.keytab
--principal=oryx/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:33683
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=37395
--tserver_master_addrs=127.10.192.126:39589
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:15.374743 19863 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:15.376137 19863 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:15.389461 19887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:15.389470 19888 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:15.390055 19890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:15.390689 19863 server_base.cc:1034] running on GCE node
I20260619 06:39:15.391489 19863 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:15.392786 19863 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:15.394034 19863 hybrid_clock.cc:648] HybridClock initialized: now 1781851155393980 us; error 44 us; skew 500 ppm
I20260619 06:39:15.394444 19863 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:39:15 dist-test-slave-7lz4 krb5kdc[19276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851155, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:39:15.398455 19863 init.cc:377] Logged in from keytab as oryx/127.10.192.65@KRBTEST.COM (short username oryx)
I20260619 06:39:15.400187 19863 webserver.cc:460] Webserver started at http://127.10.192.65:37395/ using document root <none> and password file <none>
I20260619 06:39:15.401033 19863 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:15.401168 19863 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:15.407972 19863 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260619 06:39:15.411190 19897 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:15.412961 19863 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:39:15.413132 19863 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "274d32622b644b9ab48da4a8a48f0fd9"
format_stamp: "Formatted at 2026-06-19 06:39:12 on dist-test-slave-7lz4"
server_key: "64a38ebb66965f43dc5df0ff25ae425f"
server_key_iv: "a17e1e4e611864684e42cb85a7b98616"
server_key_version: "encryptionkey@0"
I20260619 06:39:15.414496 19863 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:15.457515 19863 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:15.462277 19863 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:15.462579 19863 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:15.463706 19863 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:39:15.465245 19863 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:39:15.465349 19863 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:15.465505 19863 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:39:15.465601 19863 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:15.498893 19863 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:33683
I20260619 06:39:15.498984 20009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:33683 every 8 connection(s)
I20260619 06:39:15.500432 19863 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:39:15.508473 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 19863
I20260619 06:39:15.509132 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:38451
--local_ip_for_outbound_sockets=127.10.192.66
--tserver_master_addrs=127.10.192.126:39589
--webserver_port=37727
--webserver_interface=127.10.192.66
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:45495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.192.66
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.66.keytab with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 06:39:15 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:15 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:15.519201 20013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:15.503792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.65:36251)
0619 06:39:15.504617 (+ 825us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:15.504663 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:15.506359 (+ 1696us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:15.507851 (+ 1492us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:15.507862 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:15.508490 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:15.509144 (+ 654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:15.509162 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.510873 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.510880 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:15.512180 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:15.512193 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.513244 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.513251 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:15.513535 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:15.514251 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:15.514274 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:15.518158 (+ 3884us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":347,"threads_started":1}
W20260619 06:39:15.519948 20010 heartbeater.cc:644] Failed to heartbeat to 127.10.192.126:39589 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.192.126:39589: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
W20260619 06:39:15.520535 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:15.503677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:36251 (local address 127.10.192.126:39589)
0619 06:39:15.504463 (+ 786us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:15.504479 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:15.504785 (+ 306us) server_negotiation.cc:407] Connection header received
0619 06:39:15.506943 (+ 2158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:15.506958 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:15.507297 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:15.507694 (+ 397us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:15.509455 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.510692 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.512327 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.512996 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.513208 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:15.518616 (+ 5408us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.65:36251: BlockingRecv error: recv got EOF from 127.10.192.65:36251 (error 108)
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":280,"threads_started":1}
Jun 19 06:39:15 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:15 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:15.528748 20013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:15.520584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.65:43109)
0619 06:39:15.520861 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:15.520881 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:15.521023 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:15.521397 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:15.521401 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:15.521739 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:15.521878 (+ 139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:15.521887 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.522917 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.522922 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:15.523879 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:15.523891 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.524571 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.524577 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:15.524751 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:15.525402 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:15.525418 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:15.528457 (+ 3039us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142}
W20260619 06:39:15.528898 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:15.520808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:43109 (local address 127.10.192.126:39589)
0619 06:39:15.521137 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:15.521143 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:15.521165 (+ 22us) server_negotiation.cc:407] Connection header received
0619 06:39:15.521211 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:15.521215 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:15.521270 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:15.521372 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:15.522020 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.522768 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.524027 (+ 1259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.524424 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.524556 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:15.528654 (+ 4098us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.65:43109: BlockingRecv error: recv got EOF from 127.10.192.65:43109 (error 108)
Metrics: {"mutex_wait_us":129,"server-negotiator.queue_time_us":201}
Jun 19 06:39:15 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:15 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:15.538230 20013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:15.529677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.65:48481)
0619 06:39:15.529841 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:15.529859 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:15.529950 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:15.530344 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:15.530347 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:15.530614 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:15.530781 (+ 167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:15.530791 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.532372 (+ 1581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.532376 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:15.533281 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:15.533309 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.534244 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.534249 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:15.534414 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:15.535089 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:15.535107 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:15.538002 (+ 2895us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":52}
W20260619 06:39:15.538584 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:15.529786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:48481 (local address 127.10.192.126:39589)
0619 06:39:15.529996 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:15.530004 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:15.530027 (+ 23us) server_negotiation.cc:407] Connection header received
0619 06:39:15.530089 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:15.530097 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:15.530197 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:15.530323 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:15.530929 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.532225 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.533426 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.534064 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.534192 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:15.538268 (+ 4076us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.65:48481: BlockingRecv error: recv got EOF from 127.10.192.65:48481 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260619 06:39:15.538705 20010 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260619 06:39:15.840739 20014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:15.841066 20014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:15.841171 20014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:15.848551 20014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:15.848680 20014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:15.848795 20014 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:39:15.858830 20014 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:45495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.66.keytab
--principal=oryx/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:38451
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=37727
--tserver_master_addrs=127.10.192.126:39589
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:15.860282 20014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:15.861722 20014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:15.874619 20019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:15.875829 20022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:15.875895 20020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:15.876997 20014 server_base.cc:1034] running on GCE node
I20260619 06:39:15.877673 20014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:15.878787 20014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:15.880033 20014 hybrid_clock.cc:648] HybridClock initialized: now 1781851155879967 us; error 70 us; skew 500 ppm
I20260619 06:39:15.880371 20014 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:39:15 dist-test-slave-7lz4 krb5kdc[19276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851155, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:39:15.883534 20014 init.cc:377] Logged in from keytab as oryx/127.10.192.66@KRBTEST.COM (short username oryx)
I20260619 06:39:15.885120 20014 webserver.cc:460] Webserver started at http://127.10.192.66:37727/ using document root <none> and password file <none>
I20260619 06:39:15.885852 20014 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:15.886010 20014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:15.891451 20014 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:39:15.894166 20029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:15.895556 20014 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 06:39:15.895767 20014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "6b20b7558642446bb1cd0f330490ff66"
format_stamp: "Formatted at 2026-06-19 06:39:13 on dist-test-slave-7lz4"
server_key: "9d0adbf4badeab9952cae3c0ca49fb8c"
server_key_iv: "993ea03d1871404e2d8bb1826c2ef8f6"
server_key_version: "encryptionkey@0"
I20260619 06:39:15.896730 20014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:15.909970 20014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:15.914165 20014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:15.914462 20014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:15.915431 20014 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:39:15.916827 20014 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:39:15.916952 20014 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:15.917083 20014 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:39:15.917169 20014 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:15.950783 20014 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:38451
I20260619 06:39:15.950875 20141 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:38451 every 8 connection(s)
I20260619 06:39:15.952383 20014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:39:15.953375 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 20014
I20260619 06:39:15.954157 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:34805
--local_ip_for_outbound_sockets=127.10.192.67
--tserver_master_addrs=127.10.192.126:39589
--webserver_port=35229
--webserver_interface=127.10.192.67
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:45495
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.10.192.67
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.67.keytab with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 06:39:15 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:15 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
W20260619 06:39:15.969664 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:15.955591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:53633 (local address 127.10.192.126:39589)
0619 06:39:15.955883 (+ 292us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:15.955893 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:15.957179 (+ 1286us) server_negotiation.cc:407] Connection header received
0619 06:39:15.959087 (+ 1908us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:15.959097 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:15.959225 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:15.959367 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:15.960977 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.961712 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.963394 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.963956 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.964100 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:15.969368 (+ 5268us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.66:53633: BlockingRecv error: recv got EOF from 127.10.192.66:53633 (error 108)
Metrics: {"server-negotiator.queue_time_us":105}
I20260619 06:39:15.970413 20144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:15.956149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.66:53633)
0619 06:39:15.956979 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:15.957037 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:15.958777 (+ 1740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:15.959615 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:15.959667 (+ 52us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:15.960222 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:15.960792 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:15.960809 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.961879 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.961885 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:15.963237 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:15.963250 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.964197 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.964207 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:15.964456 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:15.965252 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:15.965276 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:15.969190 (+ 3914us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":352,"threads_started":1}
W20260619 06:39:15.971112 20142 heartbeater.cc:644] Failed to heartbeat to 127.10.192.126:39589 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.192.126:39589: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Jun 19 06:39:15 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:15 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:15.979403 20144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:15.971798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.66:38671)
0619 06:39:15.972004 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:15.972025 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:15.972145 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:15.972497 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:15.972502 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:15.972825 (+ 323us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:15.972973 (+ 148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:15.972981 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.973970 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.973976 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:15.974849 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:15.974859 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.975573 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.975578 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:15.975779 (+ 201us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:15.976382 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:15.976400 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:15.979119 (+ 2719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":60}
W20260619 06:39:15.979586 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:15.971875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:38671 (local address 127.10.192.126:39589)
0619 06:39:15.972048 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:15.972056 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:15.972076 (+ 20us) server_negotiation.cc:407] Connection header received
0619 06:39:15.972275 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:15.972280 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:15.972354 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:15.972465 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:15.973117 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.973823 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.974998 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.975414 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.975561 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:15.979325 (+ 3764us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.66:38671: BlockingRecv error: recv got EOF from 127.10.192.66:38671 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Jun 19 06:39:15 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:15 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:15.989468 20144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:15.980192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.66:46467)
0619 06:39:15.980352 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:15.980371 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:15.980459 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:15.980777 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:15.980780 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:15.981048 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:15.981272 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:15.981281 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.982789 (+ 1508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.982810 (+ 21us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:15.984325 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:15.984342 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.985130 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.985136 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:15.985350 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:15.985932 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:15.985955 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:15.989176 (+ 3221us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":40}
W20260619 06:39:15.989562 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:15.980305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:46467 (local address 127.10.192.126:39589)
0619 06:39:15.980501 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:15.980507 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:15.980525 (+ 18us) server_negotiation.cc:407] Connection header received
0619 06:39:15.980575 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:15.980580 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:15.980650 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:15.980751 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:15.981449 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.982633 (+ 1184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.984522 (+ 1889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:15.984985 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:15.985082 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:15.989360 (+ 4278us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.66:46467: BlockingRecv error: recv got EOF from 127.10.192.66:46467 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260619 06:39:15.989883 20142 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260619 06:39:16.294129 20145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:16.294436 20145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:16.294543 20145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:16.302515 20145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:16.302713 20145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:16.302928 20145 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:39:16.313093 20145 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:45495
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/krb5kdc/oryx_127.10.192.67.keytab
--principal=oryx/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:34805
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=35229
--tserver_master_addrs=127.10.192.126:39589
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:16.314570 20145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:16.315966 20145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:16.329576 20151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:16.329572 20153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:16.329568 20150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:16.330225 20145 server_base.cc:1034] running on GCE node
I20260619 06:39:16.330969 20145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:16.332018 20145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:16.333279 20145 hybrid_clock.cc:648] HybridClock initialized: now 1781851156333219 us; error 32 us; skew 500 ppm
I20260619 06:39:16.333619 20145 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:39:16 dist-test-slave-7lz4 krb5kdc[19276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851156, etypes {rep=17 tkt=17 ses=17}, oryx/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:39:16.336880 20145 init.cc:377] Logged in from keytab as oryx/127.10.192.67@KRBTEST.COM (short username oryx)
I20260619 06:39:16.338408 20145 webserver.cc:460] Webserver started at http://127.10.192.67:35229/ using document root <none> and password file <none>
I20260619 06:39:16.339131 20145 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:16.339289 20145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:16.344879 20145 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260619 06:39:16.347563 20160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:16.349023 20145 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 06:39:16.349216 20145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "8d09f662912a4272a3d8fc65a8afc9f7"
format_stamp: "Formatted at 2026-06-19 06:39:13 on dist-test-slave-7lz4"
server_key: "5b83dfb76f4b537b41fa8561221faae1"
server_key_iv: "5c3734735b9c7f5f4ee950f01b414d3a"
server_key_version: "encryptionkey@0"
I20260619 06:39:16.350281 20145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:16.372766 20145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:16.376874 20145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:16.377229 20145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:16.378328 20145 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:39:16.379803 20145 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:39:16.379925 20145 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:16.380064 20145 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:39:16.380151 20145 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:16.413491 20145 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:34805
I20260619 06:39:16.413579 20272 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:34805 every 8 connection(s)
I20260619 06:39:16.415004 20145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:39:16.418233 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 20145
Jun 19 06:39:16 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:16 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
W20260619 06:39:16.435220 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:16.417668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:34423 (local address 127.10.192.126:39589)
0619 06:39:16.417892 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:16.417899 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:16.419210 (+ 1311us) server_negotiation.cc:407] Connection header received
0619 06:39:16.422819 (+ 3609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:16.422824 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:16.422891 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:16.423021 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:16.425175 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.426335 (+ 1160us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.428613 (+ 2278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.429261 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.429345 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:16.434941 (+ 5596us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.67:34423: BlockingRecv error: recv got EOF from 127.10.192.67:34423 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
I20260619 06:39:16.435835 20275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:16.418180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.67:34423)
0619 06:39:16.419031 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:16.419088 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:16.422455 (+ 3367us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:16.423288 (+ 833us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:16.423297 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:16.424121 (+ 824us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:16.424993 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:16.425021 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.426493 (+ 1472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.426497 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:16.428492 (+ 1995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:16.428504 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.429517 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.429523 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:16.429798 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:16.430388 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:16.430428 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:16.434681 (+ 4253us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":564,"thread_start_us":331,"threads_started":1}
W20260619 06:39:16.436506 20273 heartbeater.cc:644] Failed to heartbeat to 127.10.192.126:39589 (0 consecutive failures): Not authorized: Failed to ping master at 127.10.192.126:39589: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
I20260619 06:39:16.439589 20277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:16.419303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49678 (local address 127.10.192.126:39589)
0619 06:39:16.423264 (+ 3961us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:16.423268 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:16.423281 (+ 13us) server_negotiation.cc:407] Connection header received
0619 06:39:16.423319 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:16.423323 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:16.423367 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:16.423454 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:16.425424 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.426553 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.428345 (+ 1792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.428884 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.429026 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:16.432363 (+ 3337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:16.432377 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:16.432404 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:16.432452 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:16.435837 (+ 3385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:16.436725 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:16.436733 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:16.436744 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:16.436977 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:16.437449 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:16.437454 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:16.437457 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:16.438025 (+ 568us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:16.438246 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:16.438792 (+ 546us) server_negotiation.cc:299] Negotiation successful
0619 06:39:16.439161 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3871,"thread_start_us":3747,"threads_started":1}
Jun 19 06:39:16 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:16 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:16.445283 20275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:16.437149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.67:46823)
0619 06:39:16.437342 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:16.437363 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:16.437472 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:16.437734 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:16.437737 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:16.438033 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:16.438221 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:16.438233 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.439586 (+ 1353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.439589 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:16.440623 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:16.440634 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.441403 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.441408 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:16.441586 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:16.442222 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:16.442240 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:16.445093 (+ 2853us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":62}
W20260619 06:39:16.445535 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:16.437326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:46823 (local address 127.10.192.126:39589)
0619 06:39:16.437469 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:16.437474 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:16.437492 (+ 18us) server_negotiation.cc:407] Connection header received
0619 06:39:16.437543 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:16.437547 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:16.437608 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:16.437708 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:16.438363 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.439453 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.440790 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.441256 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.441396 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:16.445268 (+ 3872us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.67:46823: BlockingRecv error: recv got EOF from 127.10.192.67:46823 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Jun 19 06:39:16 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:16 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:16.453141 20275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:16.445940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.67:49689)
0619 06:39:16.446094 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:16.446114 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:16.446217 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:16.446505 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:16.446508 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:16.446758 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:16.446894 (+ 136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:16.446901 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.447881 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.447885 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:16.448772 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:16.448782 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.449410 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.449413 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:16.449548 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:16.450154 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:16.450170 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:16.452921 (+ 2751us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260619 06:39:16.453351 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:16.446032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:49689 (local address 127.10.192.126:39589)
0619 06:39:16.446244 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:16.446248 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:16.446262 (+ 14us) server_negotiation.cc:407] Connection header received
0619 06:39:16.446302 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:16.446305 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:16.446378 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:16.446462 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:16.447009 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.447765 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.448906 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.449286 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.449386 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:16.453112 (+ 3726us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.67:49689: BlockingRecv error: recv got EOF from 127.10.192.67:49689 (error 108)
Metrics: {"server-negotiator.queue_time_us":124}
W20260619 06:39:16.453528 20273 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Jun 19 06:39:16 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:16 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:16.548450 20278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:16.539435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.65:59851)
0619 06:39:16.540067 (+ 632us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:16.540090 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:16.540249 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:16.540659 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:16.540664 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:16.541384 (+ 720us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:16.541597 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:16.541607 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.542602 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.542606 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:16.543648 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:16.543734 (+ 86us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.544490 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.544495 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:16.544629 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:16.545250 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:16.545273 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:16.548183 (+ 2910us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":337,"threads_started":1}
W20260619 06:39:16.548616 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:16.539513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:59851 (local address 127.10.192.126:39589)
0619 06:39:16.539753 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:16.539761 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:16.540170 (+ 409us) server_negotiation.cc:407] Connection header received
0619 06:39:16.540397 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:16.540400 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:16.540477 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:16.540560 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:16.541733 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.542448 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.543896 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.544324 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.544418 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:16.548394 (+ 3976us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.65:59851: BlockingRecv error: recv got EOF from 127.10.192.65:59851 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Jun 19 06:39:16 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:16 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:16.999526 20279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:16.990443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.66:53161)
0619 06:39:16.990954 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:16.990973 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:16.991129 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:16.991503 (+ 374us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:16.991507 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:16.992036 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:16.992225 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:16.992234 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.993348 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.993353 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:16.994301 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:16.994312 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.995066 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.995073 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:16.995246 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:16.995935 (+ 689us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:16.995954 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:16.999145 (+ 3191us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":263,"threads_started":1}
W20260619 06:39:16.999578 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:16.990519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:53161 (local address 127.10.192.126:39589)
0619 06:39:16.990746 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:16.990754 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:16.991053 (+ 299us) server_negotiation.cc:407] Connection header received
0619 06:39:16.991253 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:16.991259 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:16.991336 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:16.991439 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:16.992372 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.993196 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.994449 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:16.994876 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:16.995022 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:16.999350 (+ 4328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.66:53161: BlockingRecv error: recv got EOF from 127.10.192.66:53161 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Jun 19 06:39:17 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:17 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:17.468255 20280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:17.454109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.67:55209)
0619 06:39:17.454639 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:17.454660 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:17.454773 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:17.455113 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:17.455116 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:17.455588 (+ 472us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:17.455849 (+ 261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:17.455858 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:17.456906 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:17.456910 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:17.457891 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:17.457904 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:17.458579 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:17.458584 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:17.458711 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:17.464442 (+ 5731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:17.464474 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:17.467965 (+ 3491us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":313,"threads_started":1}
W20260619 06:39:17.468506 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:17.454135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:55209 (local address 127.10.192.126:39589)
0619 06:39:17.454356 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:17.454366 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:17.454736 (+ 370us) server_negotiation.cc:407] Connection header received
0619 06:39:17.454884 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:17.454888 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:17.454984 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:17.455066 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:17.455984 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:17.456727 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:17.458027 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:17.458399 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:17.458493 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:17.468220 (+ 9727us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.67:55209: BlockingRecv error: recv got EOF from 127.10.192.67:55209 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Jun 19 06:39:17 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:17 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:17.558285 20281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:17.549563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.65:60325)
0619 06:39:17.550125 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:17.550148 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:17.550309 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:17.550751 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:17.550755 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:17.551275 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:17.551517 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:17.551546 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:17.552572 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:17.552576 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:17.553532 (+ 956us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:17.553543 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:17.554245 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:17.554249 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:17.554360 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:17.554991 (+ 631us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:17.555008 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:17.557913 (+ 2905us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":291,"threads_started":1}
W20260619 06:39:17.558387 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:17.549617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:60325 (local address 127.10.192.126:39589)
0619 06:39:17.549857 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:17.549878 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:17.550260 (+ 382us) server_negotiation.cc:407] Connection header received
0619 06:39:17.550486 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:17.550491 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:17.550575 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:17.550681 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:17.551688 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:17.552451 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:17.553660 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:17.554114 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:17.554213 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:17.558144 (+ 3931us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.65:60325: BlockingRecv error: recv got EOF from 127.10.192.65:60325 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Jun 19 06:39:18 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:18 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:18.010372 20282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:18.000822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.66:51575)
0619 06:39:18.001378 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:18.001398 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:18.001584 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:18.001970 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:18.001973 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:18.002341 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:18.002582 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:18.002593 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:18.004053 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:18.004058 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:18.004969 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:18.004981 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:18.005870 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:18.005877 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:18.006035 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:18.006820 (+ 785us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:18.006858 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:18.010045 (+ 3187us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":309,"threads_started":1}
W20260619 06:39:18.010464 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:18.000934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:51575 (local address 127.10.192.126:39589)
0619 06:39:18.001103 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:18.001108 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:18.001506 (+ 398us) server_negotiation.cc:407] Connection header received
0619 06:39:18.001743 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:18.001748 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:18.001834 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:18.001930 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:18.002721 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:18.003930 (+ 1209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:18.005142 (+ 1212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:18.005687 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:18.005829 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:18.010225 (+ 4396us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.66:51575: BlockingRecv error: recv got EOF from 127.10.192.66:51575 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Jun 19 06:39:18 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:18 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:18.478163 20283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:18.469319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.67:36335)
0619 06:39:18.469952 (+ 633us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:18.469978 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:18.470130 (+ 152us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:18.470600 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:18.470604 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:18.471177 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:18.471348 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:18.471357 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:18.472430 (+ 1073us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:18.472434 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:18.473342 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:18.473352 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:18.474209 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:18.474213 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:18.474340 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:18.474917 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:18.474935 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:18.477909 (+ 2974us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":378,"threads_started":1}
W20260619 06:39:18.478534 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:18.469566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:36335 (local address 127.10.192.126:39589)
0619 06:39:18.469786 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:18.469792 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:18.470076 (+ 284us) server_negotiation.cc:407] Connection header received
0619 06:39:18.470291 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:18.470296 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:18.470431 (+ 135us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:18.470534 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:18.471496 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:18.472286 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:18.473474 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:18.473884 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:18.473979 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:18.478129 (+ 4150us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.67:36335: BlockingRecv error: recv got EOF from 127.10.192.67:36335 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Jun 19 06:39:18 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:18 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:18.567972 20284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:18.559241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.65:60277)
0619 06:39:18.559786 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:18.559802 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:18.559919 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:18.560196 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:18.560200 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:18.560550 (+ 350us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:18.560716 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:18.560725 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:18.561706 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:18.561709 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:18.562589 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:18.562599 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:18.563252 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:18.563260 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:18.563389 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:18.564169 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:18.564187 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:18.567475 (+ 3288us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":292,"threads_started":1}
W20260619 06:39:18.568043 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:18.559364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:60277 (local address 127.10.192.126:39589)
0619 06:39:18.559618 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:18.559624 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:18.559881 (+ 257us) server_negotiation.cc:407] Connection header received
0619 06:39:18.560006 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:18.560010 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:18.560071 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:18.560152 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:18.560856 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:18.561588 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:18.562713 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:18.563095 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:18.563189 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:18.567717 (+ 4528us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.65:60277: BlockingRecv error: recv got EOF from 127.10.192.65:60277 (error 108)
Metrics: {"server-negotiator.queue_time_us":86}
Jun 19 06:39:19 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:19 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:19.020151 20285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:19.011322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.66:50803)
0619 06:39:19.011952 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:19.011979 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:19.012119 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:19.012498 (+ 379us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:19.012504 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:19.012975 (+ 471us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:19.013145 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:19.013155 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:19.014267 (+ 1112us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:19.014274 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:19.015197 (+ 923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:19.015209 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:19.015994 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:19.015999 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:19.016192 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:19.016797 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:19.016814 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:19.019795 (+ 2981us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":403,"threads_started":1}
W20260619 06:39:19.020237 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:19.011395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:50803 (local address 127.10.192.126:39589)
0619 06:39:19.011577 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:19.011583 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:19.012087 (+ 504us) server_negotiation.cc:407] Connection header received
0619 06:39:19.012256 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:19.012261 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:19.012350 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:19.012462 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:19.013309 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:19.014126 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:19.015345 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:19.015838 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:19.015981 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:19.020003 (+ 4022us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.66:50803: BlockingRecv error: recv got EOF from 127.10.192.66:50803 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Jun 19 06:39:19 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:19 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:19.488241 20286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:19.479217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.67:39221)
0619 06:39:19.479757 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:19.479786 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:19.479906 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:19.480408 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:19.480412 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:19.480768 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:19.480933 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:19.480942 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:19.482101 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:19.482104 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:19.482986 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:19.482996 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:19.483864 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:19.483868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:19.483989 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:19.484713 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:19.484730 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:19.487887 (+ 3157us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":291,"threads_started":1}
W20260619 06:39:19.488360 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:19.479260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:39221 (local address 127.10.192.126:39589)
0619 06:39:19.479436 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:19.479441 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:19.479876 (+ 435us) server_negotiation.cc:407] Connection header received
0619 06:39:19.480094 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:19.480099 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:19.480206 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:19.480323 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:19.481097 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:19.481962 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:19.483127 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:19.483676 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:19.483861 (+ 185us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:19.488100 (+ 4239us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.67:39221: BlockingRecv error: recv got EOF from 127.10.192.67:39221 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Jun 19 06:39:19 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:19 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:19.577581 20287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:19.569087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.65:33327)
0619 06:39:19.569569 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:19.569585 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:19.569748 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:19.570084 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:19.570089 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:19.570483 (+ 394us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:19.570628 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:19.570637 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:19.571751 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:19.571757 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:19.572718 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:19.572730 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:19.573487 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:19.573493 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:19.573698 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:19.574337 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:19.574354 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:19.577345 (+ 2991us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":258,"threads_started":1}
W20260619 06:39:19.577854 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:19.569131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:33327 (local address 127.10.192.126:39589)
0619 06:39:19.569364 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:19.569372 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:19.569677 (+ 305us) server_negotiation.cc:407] Connection header received
0619 06:39:19.569874 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:19.569882 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:19.569947 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:19.570053 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:19.570782 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:19.571545 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:19.572867 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:19.573337 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:19.573482 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:19.577563 (+ 4081us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.65:33327: BlockingRecv error: recv got EOF from 127.10.192.65:33327 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Jun 19 06:39:20 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:20 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:20.029661 20288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:20.021258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.66:41773)
0619 06:39:20.021833 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:20.021852 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:20.021973 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:20.022330 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:20.022335 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:20.022771 (+ 436us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:20.022960 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:20.022972 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:20.023963 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:20.023968 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:20.024990 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:20.025003 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:20.025659 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:20.025663 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:20.025804 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:20.026504 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:20.026525 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:20.029434 (+ 2909us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":347,"threads_started":1}
W20260619 06:39:20.029824 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:20.021310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:41773 (local address 127.10.192.126:39589)
0619 06:39:20.021471 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:20.021476 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:20.021942 (+ 466us) server_negotiation.cc:407] Connection header received
0619 06:39:20.022074 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:20.022078 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:20.022139 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:20.022224 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:20.023112 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:20.023826 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:20.025126 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:20.025524 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:20.025614 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:20.029610 (+ 3996us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.66:41773: BlockingRecv error: recv got EOF from 127.10.192.66:41773 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Jun 19 06:39:20 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:20 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:20.502247 20289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:20.489381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.67:40229)
0619 06:39:20.489918 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:20.489945 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:20.490090 (+ 145us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:20.490521 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:20.490526 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:20.491140 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:20.491396 (+ 256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:20.491412 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:20.493126 (+ 1714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:20.493133 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:20.494525 (+ 1392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:20.494537 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:20.496002 (+ 1465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:20.496018 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:20.496297 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:20.497174 (+ 877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:20.497214 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:20.501841 (+ 4627us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":439,"threads_started":1}
W20260619 06:39:20.502298 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:20.489762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:40229 (local address 127.10.192.126:39589)
0619 06:39:20.489975 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:20.489983 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:20.490005 (+ 22us) server_negotiation.cc:407] Connection header received
0619 06:39:20.490250 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:20.490259 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:20.490368 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:20.490484 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:20.491575 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:20.492948 (+ 1373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:20.494730 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:20.495541 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:20.495710 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:20.502040 (+ 6330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.67:40229: BlockingRecv error: recv got EOF from 127.10.192.67:40229 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Jun 19 06:39:20 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:20 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:20.588450 20290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:20.578675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.65:56143)
0619 06:39:20.579235 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:20.579255 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:20.579444 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:20.579879 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:20.579889 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:20.580447 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:20.580636 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:20.580646 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:20.582124 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:20.582132 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:20.583693 (+ 1561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:20.583706 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:20.584533 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:20.584539 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:20.584715 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:20.585366 (+ 651us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:20.585389 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:20.588188 (+ 2799us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":304,"threads_started":1}
W20260619 06:39:20.588788 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:20.579126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:56143 (local address 127.10.192.126:39589)
0619 06:39:20.579323 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:20.579329 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:20.579349 (+ 20us) server_negotiation.cc:407] Connection header received
0619 06:39:20.579586 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:20.579594 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:20.579706 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:20.579815 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:20.580828 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:20.581962 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:20.583841 (+ 1879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:20.584361 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:20.584512 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:20.588413 (+ 3901us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.65:56143: BlockingRecv error: recv got EOF from 127.10.192.65:56143 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Jun 19 06:39:21 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:21 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:21.039218 20291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:21.030592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.66:57455)
0619 06:39:21.031153 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:21.031182 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:21.031346 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:21.031729 (+ 383us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:21.031734 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:21.032182 (+ 448us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:21.032341 (+ 159us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:21.032349 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:21.033395 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:21.033403 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:21.034325 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:21.034336 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:21.035065 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:21.035070 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:21.035246 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:21.035864 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:21.035882 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:21.038973 (+ 3091us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":437,"thread_start_us":252,"threads_started":1}
W20260619 06:39:21.039290 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:21.030848 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:57455 (local address 127.10.192.126:39589)
0619 06:39:21.031106 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:21.031114 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:21.031272 (+ 158us) server_negotiation.cc:407] Connection header received
0619 06:39:21.031477 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:21.031485 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:21.031558 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:21.031691 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:21.032498 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:21.033247 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:21.034481 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:21.034898 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:21.035037 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:21.039086 (+ 4049us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.66:57455: BlockingRecv error: recv got EOF from 127.10.192.66:57455 (error 108)
Metrics: {"server-negotiator.queue_time_us":118}
Jun 19 06:39:21 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:21 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:21.511730 20292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:21.503244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.67:34671)
0619 06:39:21.503785 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:21.503804 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:21.503916 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:21.504232 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:21.504235 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:21.504633 (+ 398us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:21.504795 (+ 162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:21.504804 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:21.505714 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:21.505717 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:21.506598 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:21.506609 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:21.507656 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:21.507666 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:21.507861 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:21.508598 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:21.508615 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:21.511389 (+ 2774us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":260,"threads_started":1}
W20260619 06:39:21.511996 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:21.503389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:34671 (local address 127.10.192.126:39589)
0619 06:39:21.503551 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:21.503555 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:21.503874 (+ 319us) server_negotiation.cc:407] Connection header received
0619 06:39:21.504014 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:21.504017 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:21.504092 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:21.504188 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:21.504930 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:21.505596 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:21.506746 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:21.507459 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:21.507584 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:21.511702 (+ 4118us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.67:34671: BlockingRecv error: recv got EOF from 127.10.192.67:34671 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Jun 19 06:39:21 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:21 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:21.598286 20293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:21.589630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.65:50489)
0619 06:39:21.590220 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:21.590240 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:21.590380 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:21.590690 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:21.590693 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:21.591076 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:21.591227 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:21.591234 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:21.592416 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:21.592422 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:21.593466 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:21.593481 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:21.594317 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:21.594323 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:21.594504 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:21.595094 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:21.595113 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:21.598068 (+ 2955us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":468,"thread_start_us":342,"threads_started":1}
W20260619 06:39:21.598578 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:21.589744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:50489 (local address 127.10.192.126:39589)
0619 06:39:21.589933 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:21.589938 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:21.590336 (+ 398us) server_negotiation.cc:407] Connection header received
0619 06:39:21.590487 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:21.590490 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:21.590552 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:21.590644 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:21.591396 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:21.592241 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:21.593685 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:21.594139 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:21.594271 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:21.598285 (+ 4014us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.65:50489: BlockingRecv error: recv got EOF from 127.10.192.65:50489 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Jun 19 06:39:22 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:22 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:22.048436 20294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:22.040283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.66:38085)
0619 06:39:22.040862 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:22.040885 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:22.041005 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:22.041295 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:22.041298 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:22.041683 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:22.041853 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:22.041862 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:22.042827 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:22.042831 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:22.043792 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:22.043804 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:22.044458 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:22.044463 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:22.044589 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:22.045194 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:22.045212 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:22.048188 (+ 2976us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":315,"threads_started":1}
W20260619 06:39:22.048784 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:22.040350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:38085 (local address 127.10.192.126:39589)
0619 06:39:22.040525 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:22.040529 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:22.040958 (+ 429us) server_negotiation.cc:407] Connection header received
0619 06:39:22.041102 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:22.041105 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:22.041165 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:22.041249 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:22.041973 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:22.042683 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:22.043928 (+ 1245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:22.044317 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:22.044412 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:22.048539 (+ 4127us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.66:38085: BlockingRecv error: recv got EOF from 127.10.192.66:38085 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Jun 19 06:39:22 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:22 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:22.524890 20295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:22.512810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.67:58859)
0619 06:39:22.513470 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:22.513491 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:22.513659 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:22.514020 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:22.514025 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:22.514420 (+ 395us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:22.514572 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:22.514581 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:22.515669 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:22.515678 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:22.516600 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:22.516611 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:22.517413 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:22.517419 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:22.517604 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:22.521595 (+ 3991us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:22.521615 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:22.524657 (+ 3042us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":568,"thread_start_us":386,"threads_started":1}
W20260619 06:39:22.525202 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:22.513053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:58859 (local address 127.10.192.126:39589)
0619 06:39:22.513297 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:22.513303 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:22.513584 (+ 281us) server_negotiation.cc:407] Connection header received
0619 06:39:22.513791 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:22.513797 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:22.513873 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:22.513986 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:22.514715 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:22.515472 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:22.516744 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:22.517248 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:22.517392 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:22.524892 (+ 7500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.67:58859: BlockingRecv error: recv got EOF from 127.10.192.67:58859 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Jun 19 06:39:22 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:22 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:22.608485 20296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:22.599403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.65:48311)
0619 06:39:22.600080 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:22.600096 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:22.600274 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:22.600755 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:22.600760 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:22.601227 (+ 467us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:22.601454 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:22.601464 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:22.602486 (+ 1022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:22.602491 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:22.603419 (+ 928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:22.603430 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:22.604251 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:22.604257 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:22.604422 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:22.605067 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:22.605085 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:22.608130 (+ 3045us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":318,"threads_started":1}
W20260619 06:39:22.608621 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:22.599532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:48311 (local address 127.10.192.126:39589)
0619 06:39:22.599793 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:22.599801 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:22.600197 (+ 396us) server_negotiation.cc:407] Connection header received
0619 06:39:22.600459 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:22.600463 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:22.600524 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:22.600692 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:22.601595 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:22.602325 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:22.603569 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:22.604082 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:22.604234 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:22.608342 (+ 4108us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.65:48311: BlockingRecv error: recv got EOF from 127.10.192.65:48311 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Jun 19 06:39:23 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:23 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:23.058189 20297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:23.049704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.66:51583)
0619 06:39:23.050329 (+ 625us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:23.050355 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:23.050511 (+ 156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:23.050916 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:23.050921 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:23.051334 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:23.051593 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:23.051603 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:23.052640 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:23.052643 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:23.053589 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:23.053599 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:23.054237 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:23.054241 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:23.054480 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:23.055063 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:23.055081 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:23.057919 (+ 2838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":277,"threads_started":1}
W20260619 06:39:23.058447 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:23.049801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:51583 (local address 127.10.192.126:39589)
0619 06:39:23.050057 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:23.050065 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:23.050471 (+ 406us) server_negotiation.cc:407] Connection header received
0619 06:39:23.050633 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:23.050638 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:23.050733 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:23.050846 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:23.051772 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:23.052524 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:23.053720 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:23.054110 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:23.054203 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:23.058181 (+ 3978us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.66:51583: BlockingRecv error: recv got EOF from 127.10.192.66:51583 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
Jun 19 06:39:23 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:23 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:23.534379 20298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:23.526021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.67:52629)
0619 06:39:23.526593 (+ 572us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:23.526612 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:23.526773 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:23.527133 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:23.527137 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:23.527559 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:23.527797 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:23.527807 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:23.528847 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:23.528856 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:23.529769 (+ 913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:23.529780 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:23.530541 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:23.530547 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:23.530714 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:23.531348 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:23.531367 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:23.534125 (+ 2758us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":450,"thread_start_us":304,"threads_started":1}
W20260619 06:39:23.534614 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:23.526121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:52629 (local address 127.10.192.126:39589)
0619 06:39:23.526288 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:23.526293 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:23.526711 (+ 418us) server_negotiation.cc:407] Connection header received
0619 06:39:23.526906 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:23.526914 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:23.526990 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:23.527095 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:23.527944 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:23.528709 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:23.529929 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:23.530378 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:23.530512 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:23.534346 (+ 3834us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.67:52629: BlockingRecv error: recv got EOF from 127.10.192.67:52629 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Jun 19 06:39:23 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:23 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:23.617981 20299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:23.609530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.65:43423)
0619 06:39:23.610103 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:23.610119 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:23.610235 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:23.610551 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:23.610555 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:23.610918 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:23.611058 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:23.611065 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:23.612122 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:23.612126 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:23.613186 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:23.613198 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:23.614134 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:23.614139 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:23.614284 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:23.614920 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:23.614937 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:23.617750 (+ 2813us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":306,"threads_started":1}
W20260619 06:39:23.618252 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:23.609737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:43423 (local address 127.10.192.126:39589)
0619 06:39:23.609906 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:23.609910 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:23.610195 (+ 285us) server_negotiation.cc:407] Connection header received
0619 06:39:23.610330 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:23.610334 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:23.610422 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:23.610507 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:23.611179 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:23.611990 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:23.613361 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:23.613948 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:23.614041 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:23.617977 (+ 3936us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.65:43423: BlockingRecv error: recv got EOF from 127.10.192.65:43423 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Jun 19 06:39:24 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:24 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:24.068235 20300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:24.059222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.66:45923)
0619 06:39:24.059782 (+ 560us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:24.059802 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:24.059978 (+ 176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:24.060313 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:24.060318 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:24.060759 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:24.060914 (+ 155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:24.060922 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:24.062089 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:24.062096 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:24.063319 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:24.063330 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:24.064299 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:24.064306 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:24.064480 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:24.065119 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:24.065138 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:24.068003 (+ 2865us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":451,"thread_start_us":289,"threads_started":1}
W20260619 06:39:24.068553 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:24.059328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:45923 (local address 127.10.192.126:39589)
0619 06:39:24.059584 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:24.059591 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:24.059912 (+ 321us) server_negotiation.cc:407] Connection header received
0619 06:39:24.060110 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:24.060119 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:24.060179 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:24.060285 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:24.061058 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:24.061946 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:24.063462 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:24.064106 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:24.064243 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:24.068242 (+ 3999us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.66:45923: BlockingRecv error: recv got EOF from 127.10.192.66:45923 (error 108)
Metrics: {"server-negotiator.queue_time_us":96}
Jun 19 06:39:24 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:24 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:24.543525 20301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:24.535361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.67:37729)
0619 06:39:24.535984 (+ 623us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:24.536003 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:24.536153 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:24.536502 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:24.536507 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:24.536906 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:24.537046 (+ 140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:24.537054 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:24.538079 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:24.538085 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:24.538983 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:24.538993 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:24.539756 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:24.539763 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:24.539933 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:24.540575 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:24.540592 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:24.543291 (+ 2699us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":338,"threads_started":1}
W20260619 06:39:24.543752 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:24.535415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:37729 (local address 127.10.192.126:39589)
0619 06:39:24.535616 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:24.535622 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:24.536091 (+ 469us) server_negotiation.cc:407] Connection header received
0619 06:39:24.536280 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:24.536285 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:24.536366 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:24.536472 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:24.537202 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:24.537920 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:24.539123 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:24.539553 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:24.539716 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:24.543482 (+ 3766us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.67:37729: BlockingRecv error: recv got EOF from 127.10.192.67:37729 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Jun 19 06:39:24 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:24 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:24.627300 20302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:24.619149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.65:54205)
0619 06:39:24.619795 (+ 646us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:24.619816 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:24.619969 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:24.620350 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:24.620355 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:24.620893 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:24.621102 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:24.621116 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:24.622079 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:24.622082 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:24.622999 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:24.623008 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:24.623674 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:24.623678 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:24.623801 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:24.624378 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:24.624395 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:24.627066 (+ 2671us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":340,"threads_started":1}
W20260619 06:39:24.627411 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:24.619221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:54205 (local address 127.10.192.126:39589)
0619 06:39:24.619460 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:24.619466 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:24.619913 (+ 447us) server_negotiation.cc:407] Connection header received
0619 06:39:24.620105 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:24.620113 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:24.620193 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:24.620297 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:24.621250 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:24.621962 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:24.623117 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:24.623528 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:24.623703 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:24.627248 (+ 3545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.65:54205: BlockingRecv error: recv got EOF from 127.10.192.65:54205 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Jun 19 06:39:25 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:25 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:25.077517 20303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:25.069174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.66:33199)
0619 06:39:25.069751 (+ 577us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:25.069771 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:25.069895 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:25.070189 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:25.070192 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:25.070553 (+ 361us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:25.070707 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:25.070715 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:25.072107 (+ 1392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:25.072116 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:25.073162 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:25.073174 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:25.073800 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:25.073803 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:25.073934 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:25.074491 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:25.074509 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:25.077274 (+ 2765us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":324,"threads_started":1}
W20260619 06:39:25.077694 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:25.069280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:33199 (local address 127.10.192.126:39589)
0619 06:39:25.069518 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:25.069526 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:25.069853 (+ 327us) server_negotiation.cc:407] Connection header received
0619 06:39:25.070002 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:25.070006 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:25.070068 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:25.070149 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:25.070844 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:25.071964 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:25.073288 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:25.073678 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:25.073770 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:25.077464 (+ 3694us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.66:33199: BlockingRecv error: recv got EOF from 127.10.192.66:33199 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Jun 19 06:39:25 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:25 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:25.552960 20304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:25.544640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.67:40061)
0619 06:39:25.545124 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:25.545144 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:25.545263 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:25.545563 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:25.545566 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:25.545930 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:25.546103 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:25.546111 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:25.547077 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:25.547080 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:25.548092 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:25.548104 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:25.548788 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:25.548792 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:25.548915 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:25.549588 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:25.549615 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:25.552712 (+ 3097us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":260,"threads_started":1}
W20260619 06:39:25.553124 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:25.544731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:40061 (local address 127.10.192.126:39589)
0619 06:39:25.544995 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:25.545001 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:25.545223 (+ 222us) server_negotiation.cc:407] Connection header received
0619 06:39:25.545361 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:25.545366 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:25.545434 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:25.545523 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:25.546235 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:25.546967 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:25.548238 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:25.548655 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:25.548753 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:25.552898 (+ 4145us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.67:40061: BlockingRecv error: recv got EOF from 127.10.192.67:40061 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
Jun 19 06:39:25 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:25 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:25.636746 20305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:25.628410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.65:32885)
0619 06:39:25.628969 (+ 559us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:25.628986 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:25.629100 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:25.629401 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:25.629404 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:25.629758 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:25.629902 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:25.629910 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:25.630905 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:25.630909 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:25.632075 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:25.632089 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:25.632820 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:25.632824 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:25.632933 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:25.633571 (+ 638us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:25.633588 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:25.636496 (+ 2908us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":305,"threads_started":1}
W20260619 06:39:25.637293 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:25.628494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:32885 (local address 127.10.192.126:39589)
0619 06:39:25.628686 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:25.628691 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:25.629074 (+ 383us) server_negotiation.cc:407] Connection header received
0619 06:39:25.629203 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:25.629207 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:25.629270 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:25.629355 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:25.630046 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:25.630783 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:25.632219 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:25.632687 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:25.632782 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:25.636765 (+ 3983us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.65:32885: BlockingRecv error: recv got EOF from 127.10.192.65:32885 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Jun 19 06:39:26 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:26 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:26.087810 20306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:26.078597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.66:36311)
0619 06:39:26.079199 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:26.079222 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:26.079403 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:26.079822 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:26.079827 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:26.080273 (+ 446us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:26.080469 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:26.080481 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:26.081907 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:26.081914 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:26.082959 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:26.082971 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:26.083713 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:26.083718 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:26.083887 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:26.084455 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:26.084473 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:26.087507 (+ 3034us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":458,"thread_start_us":355,"threads_started":1}
W20260619 06:39:26.088176 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:26.078682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:36311 (local address 127.10.192.126:39589)
0619 06:39:26.078972 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:26.078981 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:26.079307 (+ 326us) server_negotiation.cc:407] Connection header received
0619 06:39:26.079552 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:26.079556 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:26.079615 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:26.079788 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:26.080639 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:26.081765 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:26.083106 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:26.083535 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:26.083697 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:26.087861 (+ 4164us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.66:36311: BlockingRecv error: recv got EOF from 127.10.192.66:36311 (error 108)
Metrics: {"server-negotiator.queue_time_us":112}
Jun 19 06:39:26 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:26 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:26.561970 20307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:26.553964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.67:43921)
0619 06:39:26.554467 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:26.554487 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:26.554598 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:26.554893 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:26.554896 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:26.555337 (+ 441us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:26.555481 (+ 144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:26.555489 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:26.556623 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:26.556626 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:26.557552 (+ 926us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:26.557562 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:26.558209 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:26.558213 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:26.558321 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:26.558879 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:26.558895 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:26.561710 (+ 2815us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":406,"thread_start_us":315,"threads_started":1}
W20260619 06:39:26.562371 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:26.554116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:43921 (local address 127.10.192.126:39589)
0619 06:39:26.554363 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:26.554369 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:26.554597 (+ 228us) server_negotiation.cc:407] Connection header received
0619 06:39:26.554692 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:26.554696 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:26.554759 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:26.554853 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:26.555663 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:26.556493 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:26.557671 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:26.558084 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:26.558176 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:26.562088 (+ 3912us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.67:43921: BlockingRecv error: recv got EOF from 127.10.192.67:43921 (error 108)
Metrics: {"server-negotiator.queue_time_us":129}
Jun 19 06:39:26 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:26 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:26.645718 20308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:26.637762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.65:54637)
0619 06:39:26.638263 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:26.638280 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:26.638403 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:26.638752 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:26.638756 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:26.639142 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:26.639321 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:26.639329 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:26.640305 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:26.640308 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:26.641190 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:26.641200 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:26.641932 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:26.641946 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:26.642078 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:26.642670 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:26.642687 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:26.645474 (+ 2787us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":392,"thread_start_us":285,"threads_started":1}
W20260619 06:39:26.645905 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:26.637833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:54637 (local address 127.10.192.126:39589)
0619 06:39:26.638090 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:26.638097 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:26.638446 (+ 349us) server_negotiation.cc:407] Connection header received
0619 06:39:26.638501 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:26.638504 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:26.638580 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:26.638667 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:26.639476 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:26.640191 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:26.641342 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:26.641794 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:26.641890 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:26.645671 (+ 3781us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.65:54637: BlockingRecv error: recv got EOF from 127.10.192.65:54637 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Jun 19 06:39:27 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:27 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:27.097518 20309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:27.088800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.66:53757)
0619 06:39:27.089390 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:27.089424 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:27.089577 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:27.089947 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:27.089951 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:27.090493 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:27.090763 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:27.090775 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:27.092027 (+ 1252us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:27.092031 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:27.092928 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:27.092940 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:27.093584 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:27.093588 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:27.093711 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:27.094404 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:27.094422 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:27.097250 (+ 2828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":460,"thread_start_us":289,"threads_started":1}
W20260619 06:39:27.097681 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:27.089032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:53757 (local address 127.10.192.126:39589)
0619 06:39:27.089239 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:27.089245 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:27.089528 (+ 283us) server_negotiation.cc:407] Connection header received
0619 06:39:27.089700 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:27.089707 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:27.089772 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:27.089894 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:27.090920 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:27.091889 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:27.093054 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:27.093449 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:27.093541 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:27.097432 (+ 3891us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.66:53757: BlockingRecv error: recv got EOF from 127.10.192.66:53757 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Jun 19 06:39:27 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:27 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:27.573818 20310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:27.562877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.67:36997)
0619 06:39:27.563409 (+ 532us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:27.563429 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:27.563559 (+ 130us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:27.563954 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:27.563958 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:27.564418 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:27.564644 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:27.564653 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:27.565679 (+ 1026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:27.565683 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:27.566578 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:27.566590 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:27.567340 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:27.567344 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:27.567478 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:27.570741 (+ 3263us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:27.570759 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:27.573575 (+ 2816us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":309,"threads_started":1}
W20260619 06:39:27.574033 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:27.562929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:36997 (local address 127.10.192.126:39589)
0619 06:39:27.563151 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:27.563158 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:27.563507 (+ 349us) server_negotiation.cc:407] Connection header received
0619 06:39:27.563750 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:27.563754 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:27.563843 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:27.563927 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:27.564808 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:27.565571 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:27.566736 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:27.567196 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:27.567326 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:27.573786 (+ 6460us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.67:36997: BlockingRecv error: recv got EOF from 127.10.192.67:36997 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Jun 19 06:39:27 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:27 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:27.655773 20311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:27.646709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.65:55979)
0619 06:39:27.647189 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:27.647207 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:27.647335 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:27.647721 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:27.647726 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:27.648222 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:27.648418 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:27.648427 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:27.649515 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:27.649519 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:27.650468 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:27.650479 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:27.651250 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:27.651254 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:27.651422 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:27.652012 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:27.652029 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:27.655459 (+ 3430us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":282,"threads_started":1}
W20260619 06:39:27.656013 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:27.646894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:55979 (local address 127.10.192.126:39589)
0619 06:39:27.647167 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:27.647174 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:27.647308 (+ 134us) server_negotiation.cc:407] Connection header received
0619 06:39:27.647458 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:27.647462 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:27.647525 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:27.647606 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:27.648584 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:27.649361 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:27.650630 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:27.651110 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:27.651213 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:27.655742 (+ 4529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.65:55979: BlockingRecv error: recv got EOF from 127.10.192.65:55979 (error 108)
Metrics: {"server-negotiator.queue_time_us":120}
Jun 19 06:39:28 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:28 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:28.107044 20312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:28.098509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.66:37305)
0619 06:39:28.099075 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:28.099100 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:28.099219 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:28.099532 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:28.099536 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:28.100005 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:28.100251 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:28.100261 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:28.101318 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:28.101322 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:28.102376 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:28.102389 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:28.103059 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:28.103063 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:28.103200 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:28.103923 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:28.103944 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:28.106795 (+ 2851us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":340,"threads_started":1}
W20260619 06:39:28.107295 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:28.098566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:37305 (local address 127.10.192.126:39589)
0619 06:39:28.098762 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:28.098766 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:28.099176 (+ 410us) server_negotiation.cc:407] Connection header received
0619 06:39:28.099318 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:28.099322 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:28.099384 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:28.099469 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:28.100385 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:28.101180 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:28.102503 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:28.102902 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:28.103000 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:28.107051 (+ 4051us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.66:37305: BlockingRecv error: recv got EOF from 127.10.192.66:37305 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Jun 19 06:39:28 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:28 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:28.583503 20313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:28.574855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.67:39027)
0619 06:39:28.575461 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:28.575483 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:28.575673 (+ 190us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:28.576067 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:28.576070 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:28.576474 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:28.576625 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:28.576633 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:28.577615 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:28.577619 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:28.578690 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:28.578703 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:28.579498 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:28.579505 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:28.579709 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:28.580324 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:28.580361 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:28.583133 (+ 2772us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":326,"threads_started":1}
W20260619 06:39:28.583590 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:28.574878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:39027 (local address 127.10.192.126:39589)
0619 06:39:28.575081 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:28.575090 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:28.575601 (+ 511us) server_negotiation.cc:407] Connection header received
0619 06:39:28.575807 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:28.575814 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:28.575918 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:28.576020 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:28.576740 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:28.577474 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:28.578835 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:28.579345 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:28.579482 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:28.583344 (+ 3862us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.67:39027: BlockingRecv error: recv got EOF from 127.10.192.67:39027 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Jun 19 06:39:28 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:28 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:28.665752 20314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:28.656846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.65:34545)
0619 06:39:28.657426 (+ 580us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:28.657443 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:28.657557 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:28.657831 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:28.657834 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:28.658226 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:28.658391 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:28.658400 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:28.659377 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:28.659382 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:28.660405 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:28.660419 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:28.661219 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:28.661226 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:28.661385 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:28.662196 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:28.662223 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:28.665503 (+ 3280us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":301,"threads_started":1}
W20260619 06:39:28.665900 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:28.656965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:34545 (local address 127.10.192.126:39589)
0619 06:39:28.657199 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:28.657203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:28.657520 (+ 317us) server_negotiation.cc:407] Connection header received
0619 06:39:28.657660 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:28.657664 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:28.657724 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:28.657811 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:28.658526 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:28.659222 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:28.660557 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:28.660996 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:28.661095 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:28.665687 (+ 4592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.65:34545: BlockingRecv error: recv got EOF from 127.10.192.65:34545 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
Jun 19 06:39:29 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:29 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:29.116360 20315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:29.108163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.66:36029)
0619 06:39:29.108742 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:29.108761 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:29.108876 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:29.109168 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:29.109171 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:29.109570 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:29.109726 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:29.109734 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:29.110718 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:29.110722 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:29.111757 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:29.111770 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:29.112479 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:29.112483 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:29.112596 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:29.113212 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:29.113230 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:29.116120 (+ 2890us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":469,"thread_start_us":322,"threads_started":1}
W20260619 06:39:29.116583 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:29.108303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:36029 (local address 127.10.192.126:39589)
0619 06:39:29.108475 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:29.108479 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:29.108832 (+ 353us) server_negotiation.cc:407] Connection header received
0619 06:39:29.108980 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:29.108984 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:29.109043 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:29.109124 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:29.109844 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:29.110593 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:29.111886 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:29.112291 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:29.112385 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:29.116327 (+ 3942us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.66:36029: BlockingRecv error: recv got EOF from 127.10.192.66:36029 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Jun 19 06:39:29 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:29 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:29.593843 20316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:29.584630 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.67:46177)
0619 06:39:29.585191 (+ 561us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:29.585210 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:29.585324 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:29.585635 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:29.585638 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:29.586009 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:29.586165 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:29.586172 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:29.587192 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:29.587203 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:29.588638 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:29.588656 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:29.589692 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:29.589699 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:29.589901 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:29.590503 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:29.590522 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:29.593574 (+ 3052us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":288,"threads_started":1}
W20260619 06:39:29.594033 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:29.584691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:46177 (local address 127.10.192.126:39589)
0619 06:39:29.584855 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:29.584860 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:29.585283 (+ 423us) server_negotiation.cc:407] Connection header received
0619 06:39:29.585441 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:29.585444 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:29.585504 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:29.585591 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:29.586288 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:29.587008 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:29.588822 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:29.589474 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:29.589575 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:29.593799 (+ 4224us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.67:46177: BlockingRecv error: recv got EOF from 127.10.192.67:46177 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Jun 19 06:39:29 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:29 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:29.675803 20317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:29.666656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.65:60831)
0619 06:39:29.667208 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:29.667226 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:29.667399 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:29.667815 (+ 416us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:29.667823 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:29.668301 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:29.668498 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:29.668509 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:29.669672 (+ 1163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:29.669679 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:29.670633 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:29.670644 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:29.671419 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:29.671426 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:29.671695 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:29.672360 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:29.672379 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:29.675418 (+ 3039us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":435,"thread_start_us":301,"threads_started":1}
W20260619 06:39:29.675884 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:29.666770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:60831 (local address 127.10.192.126:39589)
0619 06:39:29.667100 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:29.667107 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:29.667347 (+ 240us) server_negotiation.cc:407] Connection header received
0619 06:39:29.667566 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:29.667570 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:29.667657 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:29.667774 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:29.668655 (+ 881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:29.669512 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:29.670804 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:29.671252 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:29.671410 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:29.675619 (+ 4209us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.65:60831: BlockingRecv error: recv got EOF from 127.10.192.65:60831 (error 108)
Metrics: {"server-negotiator.queue_time_us":162}
Jun 19 06:39:30 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:30 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:30.125102 20318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:30.117280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.66:50721)
0619 06:39:30.117802 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:30.117822 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:30.117948 (+ 126us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:30.118229 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:30.118232 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:30.118584 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:30.118759 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:30.118768 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:30.119750 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:30.119754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:30.120761 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:30.120773 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:30.121395 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:30.121399 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:30.121514 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:30.122144 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:30.122162 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:30.124829 (+ 2667us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":294,"threads_started":1}
W20260619 06:39:30.125279 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:30.117364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:50721 (local address 127.10.192.126:39589)
0619 06:39:30.117543 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:30.117548 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:30.117890 (+ 342us) server_negotiation.cc:407] Connection header received
0619 06:39:30.118050 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:30.118054 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:30.118112 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:30.118192 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:30.118876 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:30.119638 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:30.120871 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:30.121275 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:30.121365 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:30.125071 (+ 3706us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.66:50721: BlockingRecv error: recv got EOF from 127.10.192.66:50721 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Jun 19 06:39:30 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:30 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.67@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:30.603364 20319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:30.594825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.67:43233)
0619 06:39:30.595275 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:30.595296 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:30.595447 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:30.595784 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:30.595787 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:30.596218 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:30.596421 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:30.596429 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:30.597418 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:30.597422 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:30.598329 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:30.598339 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:30.598995 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:30.598999 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:30.599115 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:30.599835 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:30.599852 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:30.603114 (+ 3262us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":257,"threads_started":1}
W20260619 06:39:30.603569 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:30.594989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:43233 (local address 127.10.192.126:39589)
0619 06:39:30.595222 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:30.595228 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:30.595377 (+ 149us) server_negotiation.cc:407] Connection header received
0619 06:39:30.595572 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:30.595576 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:30.595660 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:30.595742 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:30.596547 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:30.597276 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:30.598469 (+ 1193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:30.598876 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:30.598972 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:30.603321 (+ 4349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.67:43233: BlockingRecv error: recv got EOF from 127.10.192.67:43233 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Jun 19 06:39:30 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:30 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.65@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:30.685029 20320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:30.677182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.65:37157)
0619 06:39:30.677677 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:30.677693 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:30.677799 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:30.678104 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:30.678108 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:30.678591 (+ 483us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:30.678765 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:30.678774 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:30.679822 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:30.679826 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:30.680737 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:30.680748 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:30.681383 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:30.681387 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:30.681495 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:30.682153 (+ 658us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:30.682171 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:30.684772 (+ 2601us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":285,"threads_started":1}
W20260619 06:39:30.685249 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:30.677218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:37157 (local address 127.10.192.126:39589)
0619 06:39:30.677436 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:30.677445 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:30.677772 (+ 327us) server_negotiation.cc:407] Connection header received
0619 06:39:30.677910 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:30.677913 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:30.677973 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:30.678066 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:30.678899 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:30.679700 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:30.680855 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:30.681268 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:30.681355 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:30.684996 (+ 3641us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.65:37157: BlockingRecv error: recv got EOF from 127.10.192.65:37157 (error 108)
Metrics: {"server-negotiator.queue_time_us":59}
Jun 19 06:39:31 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
Jun 19 06:39:31 dist-test-slave-7lz4 krb5kdc[19276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.10.192.66@KRBTEST.COM for oryx/127.10.192.126@KRBTEST.COM, Server not found in Kerberos database
I20260619 06:39:31.135303 20321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:31.126515 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39589 (local address 127.10.192.66:51645)
0619 06:39:31.127104 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:31.127124 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:31.127286 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:31.127693 (+ 407us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:31.127698 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:31.128129 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:31.128294 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:31.128302 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:31.129360 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:31.129366 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:31.130316 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:31.130328 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:31.131072 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:31.131085 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:31.131252 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:31.132055 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:31.132076 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:31.135051 (+ 2975us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.10.192.126:39589: Server oryx/127.10.192.126@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":324,"threads_started":1}
W20260619 06:39:31.135486 20012 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:31.126614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:51645 (local address 127.10.192.126:39589)
0619 06:39:31.126868 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:31.126876 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:31.127213 (+ 337us) server_negotiation.cc:407] Connection header received
0619 06:39:31.127415 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:31.127420 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:31.127501 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:31.127614 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:31.128445 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:31.129209 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:31.130459 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:31.130917 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:31.131049 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:31.135251 (+ 4202us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.10.192.66:51645: BlockingRecv error: recv got EOF from 127.10.192.66:51645 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
I20260619 06:39:31.427186 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 19863
I20260619 06:39:31.439585 20323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:31.428528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33860 (local address 127.10.192.65:33683)
0619 06:39:31.429188 (+ 660us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:31.429195 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:31.429224 (+ 29us) server_negotiation.cc:407] Connection header received
0619 06:39:31.429287 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:31.429294 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:31.429550 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:31.429710 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:31.431097 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:31.432186 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:31.433377 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:31.433949 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:31.434055 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:31.436588 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:31.436595 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:31.436609 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:31.436647 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:31.439080 (+ 2433us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.192.65@KRBTEST.COM not found in keytab (ticket kvno 2)
0619 06:39:31.439345 (+ 265us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33860: Request ticket server kudu/127.10.192.65@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":371,"threads_started":1}
W20260619 06:39:31.439752 20323 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:33860: Request ticket server kudu/127.10.192.65@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260619 06:39:31.439770 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 19863: Not authorized: Client connection negotiation failed: client connection to 127.10.192.65:33683: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.192.65@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260619 06:39:31.440035 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 19863
I20260619 06:39:31.456974 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 20014
I20260619 06:39:31.469456 20324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:31.458058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55658 (local address 127.10.192.66:38451)
0619 06:39:31.458631 (+ 573us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:31.458638 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:31.458668 (+ 30us) server_negotiation.cc:407] Connection header received
0619 06:39:31.458729 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:31.458735 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:31.458976 (+ 241us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:31.459189 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:31.460579 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:31.461638 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:31.462910 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:31.463511 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:31.463747 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:31.466213 (+ 2466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:31.466221 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:31.466238 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:31.466271 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:31.468754 (+ 2483us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.192.66@KRBTEST.COM not found in keytab (ticket kvno 2)
0619 06:39:31.469115 (+ 361us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:55658: Request ticket server kudu/127.10.192.66@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":434,"thread_start_us":284,"threads_started":1}
W20260619 06:39:31.469586 20324 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:55658: Request ticket server kudu/127.10.192.66@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260619 06:39:31.469558 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 20014: Not authorized: Client connection negotiation failed: client connection to 127.10.192.66:38451: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.192.66@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260619 06:39:31.469875 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 20014
I20260619 06:39:31.487040 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 20145
I20260619 06:39:31.499567 20325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:31.488137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54760 (local address 127.10.192.67:34805)
0619 06:39:31.488742 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:31.488751 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:31.488777 (+ 26us) server_negotiation.cc:407] Connection header received
0619 06:39:31.488839 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:31.488844 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:31.489071 (+ 227us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:31.489227 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:31.490656 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:31.491842 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:31.493110 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:31.493707 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:31.493833 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:31.496398 (+ 2565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:31.496407 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:31.496421 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:31.496461 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:31.499063 (+ 2602us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.192.67@KRBTEST.COM not found in keytab (ticket kvno 2)
0619 06:39:31.499325 (+ 262us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54760: Request ticket server kudu/127.10.192.67@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":323,"threads_started":1}
W20260619 06:39:31.499837 20325 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54760: Request ticket server kudu/127.10.192.67@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260619 06:39:31.499856 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 20145: Not authorized: Client connection negotiation failed: client connection to 127.10.192.67:34805: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.10.192.67@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260619 06:39:31.500029 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 20145
I20260619 06:39:31.515882 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 19794
I20260619 06:39:31.517225 19856 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:31.634500 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 19794
2026-06-19T06:39:31Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (21215 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-06-19T06:39:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:39:31Z Disabled control of system clock
I20260619 06:39:31.714437 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:40353
--webserver_interface=127.10.192.126
--webserver_port=0
--builtin_ntp_servers=127.10.192.84:40997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:40353
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260619 06:39:32.051379 20330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:32.051795 20330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:32.051951 20330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:32.059499 20330 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:39:32.059621 20330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:32.059744 20330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:32.059827 20330 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:39:32.059888 20330 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:39:32.069496 20330 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:40997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:40353
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:40353
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:32.070868 20330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:32.072817 20330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:32.085829 20338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:32.085783 20335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:32.085865 20336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:32.086491 20330 server_base.cc:1034] running on GCE node
I20260619 06:39:32.087546 20330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:32.089224 20330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:32.090482 20330 hybrid_clock.cc:648] HybridClock initialized: now 1781851172090427 us; error 55 us; skew 500 ppm
I20260619 06:39:32.090873 20330 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:39:32.093611 20330 webserver.cc:460] Webserver started at http://127.10.192.126:32985/ using document root <none> and password file <none>
I20260619 06:39:32.094487 20330 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:32.094632 20330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:32.094973 20330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:32.098196 20330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "510d27062ba749ccbcb5fa80ce9dc0a6"
format_stamp: "Formatted at 2026-06-19 06:39:32 on dist-test-slave-7lz4"
server_key: "d32bc5760e4f266f40e896d20c2e75d9"
server_key_iv: "2661a7e62e535b77bb529166acbf7718"
server_key_version: "encryptionkey@0"
I20260619 06:39:32.098982 20330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "510d27062ba749ccbcb5fa80ce9dc0a6"
format_stamp: "Formatted at 2026-06-19 06:39:32 on dist-test-slave-7lz4"
server_key: "d32bc5760e4f266f40e896d20c2e75d9"
server_key_iv: "2661a7e62e535b77bb529166acbf7718"
server_key_version: "encryptionkey@0"
I20260619 06:39:32.104375 20330 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260619 06:39:32.108126 20344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:32.109647 20330 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:39:32.109803 20330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "510d27062ba749ccbcb5fa80ce9dc0a6"
format_stamp: "Formatted at 2026-06-19 06:39:32 on dist-test-slave-7lz4"
server_key: "d32bc5760e4f266f40e896d20c2e75d9"
server_key_iv: "2661a7e62e535b77bb529166acbf7718"
server_key_version: "encryptionkey@0"
I20260619 06:39:32.109997 20330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:32.155606 20330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:32.156490 20330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:32.156742 20330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:32.175622 20330 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:40353
I20260619 06:39:32.175649 20395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:40353 every 8 connection(s)
I20260619 06:39:32.177125 20330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:39:32.178726 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 20330
I20260619 06:39:32.178934 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:39:32.179592 11009 external_mini_cluster.cc:1428] Setting key f901ef5c24650c456ac2bcf826045ff3
I20260619 06:39:32.181566 20396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:32.196339 20399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:32.181759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41088 (local address 127.10.192.126:40353)
0619 06:39:32.183289 (+ 1530us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:32.183305 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:32.183363 (+ 58us) server_negotiation.cc:407] Connection header received
0619 06:39:32.185475 (+ 2112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:32.185508 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:32.186191 (+ 683us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:32.186677 (+ 486us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:32.187241 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:32.189312 (+ 2071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:32.190717 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:32.191761 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:32.191950 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:32.193210 (+ 1260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:32.193220 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:32.193239 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:39:32.194047 (+ 808us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:32.194173 (+ 126us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:39:32.194207 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:32.194321 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:32.194604 (+ 283us) server_negotiation.cc:299] Negotiation successful
0619 06:39:32.194979 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":317,"threads_started":1}
I20260619 06:39:32.197145 20396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6: Bootstrap starting.
I20260619 06:39:32.200393 20396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:32.201440 20396 log.cc:824] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6: Log is configured to *not* fsync() on all Append() calls
I20260619 06:39:32.204671 20396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6: No bootstrap required, opened a new log
I20260619 06:39:32.212177 20396 raft_consensus.cc:348] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "510d27062ba749ccbcb5fa80ce9dc0a6" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40353 } }
I20260619 06:39:32.212539 20396 raft_consensus.cc:374] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:32.212611 20396 raft_consensus.cc:729] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 510d27062ba749ccbcb5fa80ce9dc0a6, State: Initialized, Role: FOLLOWER
I20260619 06:39:32.213140 20396 consensus_queue.cc:260] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "510d27062ba749ccbcb5fa80ce9dc0a6" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40353 } }
I20260619 06:39:32.213402 20396 raft_consensus.cc:388] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:39:32.213537 20396 raft_consensus.cc:482] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:39:32.213728 20396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:32.216368 20396 raft_consensus.cc:504] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "510d27062ba749ccbcb5fa80ce9dc0a6" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40353 } }
I20260619 06:39:32.216929 20396 leader_election.cc:302] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 510d27062ba749ccbcb5fa80ce9dc0a6; no voters:
I20260619 06:39:32.217547 20396 leader_election.cc:288] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:39:32.217707 20401 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:39:32.218462 20401 raft_consensus.cc:686] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6 [term 1 LEADER]: Becoming Leader. State: Replica: 510d27062ba749ccbcb5fa80ce9dc0a6, State: Running, Role: LEADER
I20260619 06:39:32.219059 20401 consensus_queue.cc:237] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "510d27062ba749ccbcb5fa80ce9dc0a6" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40353 } }
I20260619 06:39:32.219719 20396 sys_catalog.cc:564] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:39:32.222106 20402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "510d27062ba749ccbcb5fa80ce9dc0a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "510d27062ba749ccbcb5fa80ce9dc0a6" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40353 } } }
I20260619 06:39:32.222517 20402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6 [sys.catalog]: This master's current role is: LEADER
I20260619 06:39:32.222990 20403 sys_catalog.cc:455] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 510d27062ba749ccbcb5fa80ce9dc0a6. Latest consensus state: current_term: 1 leader_uuid: "510d27062ba749ccbcb5fa80ce9dc0a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "510d27062ba749ccbcb5fa80ce9dc0a6" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40353 } } }
I20260619 06:39:32.223254 20403 sys_catalog.cc:458] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6 [sys.catalog]: This master's current role is: LEADER
I20260619 06:39:32.225641 20409 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:39:32.230624 20409 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:39:32.239706 20409 catalog_manager.cc:1347] Generated new cluster ID: 14638f0b3e47492bbdc434fcf33dcba1
I20260619 06:39:32.239852 20409 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:39:32.263242 20409 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:39:32.264684 20409 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:39:32.271835 20409 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 510d27062ba749ccbcb5fa80ce9dc0a6: Generated new TSK 0
I20260619 06:39:32.272786 20409 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:39:32.284060 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:40353
--builtin_ntp_servers=127.10.192.84:40997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260619 06:39:32.622225 20420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:32.622541 20420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:32.622627 20420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:32.630350 20420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:32.630468 20420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:32.630576 20420 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:39:32.639861 20420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:40997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:40353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:32.641130 20420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:32.642915 20420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:32.656243 20425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:32.656211 20426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:32.656291 20428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:32.657562 20420 server_base.cc:1034] running on GCE node
I20260619 06:39:32.658231 20420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:32.659224 20420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:32.660454 20420 hybrid_clock.cc:648] HybridClock initialized: now 1781851172660400 us; error 53 us; skew 500 ppm
I20260619 06:39:32.660779 20420 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:39:32.666452 20420 webserver.cc:460] Webserver started at http://127.10.192.65:45525/ using document root <none> and password file <none>
I20260619 06:39:32.667230 20420 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:32.667371 20420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:32.667779 20420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:32.670696 20420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "324f5303399a4bb3b5ba0623c69a287b"
format_stamp: "Formatted at 2026-06-19 06:39:32 on dist-test-slave-7lz4"
server_key: "4793c51c6e361f79beb12d2d5d9d4238"
server_key_iv: "a30d585e50c21d75aa5e196d4b5a47cc"
server_key_version: "encryptionkey@0"
I20260619 06:39:32.671556 20420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "324f5303399a4bb3b5ba0623c69a287b"
format_stamp: "Formatted at 2026-06-19 06:39:32 on dist-test-slave-7lz4"
server_key: "4793c51c6e361f79beb12d2d5d9d4238"
server_key_iv: "a30d585e50c21d75aa5e196d4b5a47cc"
server_key_version: "encryptionkey@0"
I20260619 06:39:32.676834 20420 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260619 06:39:32.680352 20434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:32.681807 20420 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:39:32.682009 20420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "324f5303399a4bb3b5ba0623c69a287b"
format_stamp: "Formatted at 2026-06-19 06:39:32 on dist-test-slave-7lz4"
server_key: "4793c51c6e361f79beb12d2d5d9d4238"
server_key_iv: "a30d585e50c21d75aa5e196d4b5a47cc"
server_key_version: "encryptionkey@0"
I20260619 06:39:32.682226 20420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:32.716660 20420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:32.717593 20420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:32.717892 20420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:32.718888 20420 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:39:32.720664 20420 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:39:32.720780 20420 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:32.720920 20420 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:39:32.721006 20420 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:32.754420 20420 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:38397
I20260619 06:39:32.754513 20546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:38397 every 8 connection(s)
I20260619 06:39:32.755793 20420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:39:32.758025 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 20420
I20260619 06:39:32.758216 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:39:32.758967 11009 external_mini_cluster.cc:1428] Setting key 6db9ef36441c3553949b070777b76812
I20260619 06:39:32.762295 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:40353
--builtin_ntp_servers=127.10.192.84:40997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260619 06:39:32.771903 20549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:32.758747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:43965 (local address 127.10.192.126:40353)
0619 06:39:32.759256 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:32.759263 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:32.760765 (+ 1502us) server_negotiation.cc:407] Connection header received
0619 06:39:32.763406 (+ 2641us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:32.763411 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:32.763508 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:32.763600 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:32.765193 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:32.765997 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:32.768600 (+ 2603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:32.769002 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:32.769104 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:32.770890 (+ 1786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:32.770897 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:32.770901 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:39:32.770929 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:32.770991 (+ 62us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:39:32.771016 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:32.771087 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:32.771349 (+ 262us) server_negotiation.cc:299] Negotiation successful
0619 06:39:32.771504 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":266,"threads_started":1}
I20260619 06:39:32.773034 20550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:32.759415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:40353 (local address 127.10.192.65:43965)
0619 06:39:32.760582 (+ 1167us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:32.760630 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:32.763068 (+ 2438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:32.763976 (+ 908us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:32.763993 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:32.764131 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:32.765012 (+ 881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:32.765040 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:32.766169 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:32.766177 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:32.768449 (+ 2272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:32.768467 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:32.769246 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:32.769255 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:32.769616 (+ 361us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:32.770468 (+ 852us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:39:32.770471 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:32.770515 (+ 44us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:39:32.770598 (+ 83us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:39:32.771111 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:39:32.771119 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:39:32.771126 (+ 7us) client_negotiation.cc:769] Sending connection context
0619 06:39:32.771313 (+ 187us) client_negotiation.cc:240] Negotiation successful
0619 06:39:32.771760 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":373,"threads_started":1}
I20260619 06:39:32.774714 20547 heartbeater.cc:347] Connected to a master server at 127.10.192.126:40353
I20260619 06:39:32.775056 20547 heartbeater.cc:464] Registering TS with master...
I20260619 06:39:32.775949 20547 heartbeater.cc:511] Master 127.10.192.126:40353 requested a full tablet report, sending...
I20260619 06:39:32.778029 20361 ts_manager.cc:194] Registered new tserver with Master: 324f5303399a4bb3b5ba0623c69a287b (127.10.192.65:38397)
I20260619 06:39:32.779515 20361 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.192.65:43965
W20260619 06:39:33.118611 20551 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:33.118901 20551 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:33.119043 20551 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:33.126664 20551 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:33.126766 20551 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:33.126938 20551 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:39:33.136449 20551 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:40997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:40353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:33.137883 20551 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:33.139739 20551 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:33.153954 20557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:33.154033 20559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:33.154048 20556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:33.154232 20551 server_base.cc:1034] running on GCE node
I20260619 06:39:33.155084 20551 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:33.156179 20551 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:33.157440 20551 hybrid_clock.cc:648] HybridClock initialized: now 1781851173157384 us; error 47 us; skew 500 ppm
I20260619 06:39:33.157825 20551 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:39:33.160356 20551 webserver.cc:460] Webserver started at http://127.10.192.66:34663/ using document root <none> and password file <none>
I20260619 06:39:33.161114 20551 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:33.161252 20551 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:33.161589 20551 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:33.164601 20551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "00b305bf42fb4993822f2fd7c1582b96"
format_stamp: "Formatted at 2026-06-19 06:39:33 on dist-test-slave-7lz4"
server_key: "c7a91756bfa07c66920f0d4b31edcaa2"
server_key_iv: "7adf2fc387be493487b60bed6dcce1bc"
server_key_version: "encryptionkey@0"
I20260619 06:39:33.165417 20551 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "00b305bf42fb4993822f2fd7c1582b96"
format_stamp: "Formatted at 2026-06-19 06:39:33 on dist-test-slave-7lz4"
server_key: "c7a91756bfa07c66920f0d4b31edcaa2"
server_key_iv: "7adf2fc387be493487b60bed6dcce1bc"
server_key_version: "encryptionkey@0"
I20260619 06:39:33.170516 20551 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 06:39:33.174041 20565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:33.175521 20551 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260619 06:39:33.175740 20551 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "00b305bf42fb4993822f2fd7c1582b96"
format_stamp: "Formatted at 2026-06-19 06:39:33 on dist-test-slave-7lz4"
server_key: "c7a91756bfa07c66920f0d4b31edcaa2"
server_key_iv: "7adf2fc387be493487b60bed6dcce1bc"
server_key_version: "encryptionkey@0"
I20260619 06:39:33.175979 20551 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:33.202708 20551 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:33.203665 20551 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:33.204013 20551 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:33.205035 20551 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:39:33.206475 20551 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:39:33.206601 20551 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:33.206743 20551 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:39:33.206830 20551 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:33.240001 20551 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:41011
I20260619 06:39:33.240091 20677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:41011 every 8 connection(s)
I20260619 06:39:33.241364 20551 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:39:33.248881 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 20551
I20260619 06:39:33.249043 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:39:33.249495 11009 external_mini_cluster.cc:1428] Setting key ed833d7c958a564cb82527611bc7e088
I20260619 06:39:33.252540 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:40353
--builtin_ntp_servers=127.10.192.84:40997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260619 06:39:33.254520 20549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:33.244074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:51227 (local address 127.10.192.126:40353)
0619 06:39:33.244253 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:33.244257 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:33.245627 (+ 1370us) server_negotiation.cc:407] Connection header received
0619 06:39:33.247407 (+ 1780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:33.247413 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:33.247513 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:33.247626 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:33.248857 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:33.249726 (+ 869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:33.251613 (+ 1887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:33.252059 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:33.252158 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:33.253766 (+ 1608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:33.253771 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:33.253774 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:39:33.253792 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:33.253824 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:39:33.253835 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:33.253910 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:33.254189 (+ 279us) server_negotiation.cc:299] Negotiation successful
0619 06:39:33.254264 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260619 06:39:33.256132 20680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:33.244539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:40353 (local address 127.10.192.66:51227)
0619 06:39:33.245458 (+ 919us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:33.245498 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:33.247119 (+ 1621us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:33.247879 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:33.247888 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:33.247994 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:33.248665 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:33.248691 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:33.249883 (+ 1192us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:33.249888 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:33.251451 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:33.251488 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:33.252295 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:33.252303 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:33.252610 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:33.253372 (+ 762us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:39:33.253378 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:33.253436 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:39:33.253556 (+ 120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:39:33.253947 (+ 391us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:39:33.253961 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:39:33.253972 (+ 11us) client_negotiation.cc:769] Sending connection context
0619 06:39:33.254178 (+ 206us) client_negotiation.cc:240] Negotiation successful
0619 06:39:33.254673 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":278,"threads_started":1}
I20260619 06:39:33.257692 20678 heartbeater.cc:347] Connected to a master server at 127.10.192.126:40353
I20260619 06:39:33.258036 20678 heartbeater.cc:464] Registering TS with master...
I20260619 06:39:33.258802 20678 heartbeater.cc:511] Master 127.10.192.126:40353 requested a full tablet report, sending...
I20260619 06:39:33.260337 20361 ts_manager.cc:194] Registered new tserver with Master: 00b305bf42fb4993822f2fd7c1582b96 (127.10.192.66:41011)
I20260619 06:39:33.261221 20361 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.192.66:51227
W20260619 06:39:33.586404 20681 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:33.586759 20681 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:33.586931 20681 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:33.594264 20681 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:33.594389 20681 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:33.594568 20681 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:39:33.603991 20681 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:40997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:40353
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:33.605412 20681 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:33.607241 20681 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:33.620918 20686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:33.620961 20687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:33.621165 20689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:33.621919 20681 server_base.cc:1034] running on GCE node
I20260619 06:39:33.622538 20681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:33.623538 20681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:33.624790 20681 hybrid_clock.cc:648] HybridClock initialized: now 1781851173624756 us; error 75 us; skew 500 ppm
I20260619 06:39:33.625128 20681 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:39:33.627714 20681 webserver.cc:460] Webserver started at http://127.10.192.67:34061/ using document root <none> and password file <none>
I20260619 06:39:33.628482 20681 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:33.628612 20681 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:33.628963 20681 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:33.632113 20681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "08e8a26691e342a4ab943ad38c706f49"
format_stamp: "Formatted at 2026-06-19 06:39:33 on dist-test-slave-7lz4"
server_key: "fab622477a1e8574cd1c2b0e9f75a1b1"
server_key_iv: "48c238ba6b9ddddc2af08c0e66adb83a"
server_key_version: "encryptionkey@0"
I20260619 06:39:33.632952 20681 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "08e8a26691e342a4ab943ad38c706f49"
format_stamp: "Formatted at 2026-06-19 06:39:33 on dist-test-slave-7lz4"
server_key: "fab622477a1e8574cd1c2b0e9f75a1b1"
server_key_iv: "48c238ba6b9ddddc2af08c0e66adb83a"
server_key_version: "encryptionkey@0"
I20260619 06:39:33.638240 20681 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 06:39:33.641902 20695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:33.643374 20681 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 06:39:33.643716 20681 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "08e8a26691e342a4ab943ad38c706f49"
format_stamp: "Formatted at 2026-06-19 06:39:33 on dist-test-slave-7lz4"
server_key: "fab622477a1e8574cd1c2b0e9f75a1b1"
server_key_iv: "48c238ba6b9ddddc2af08c0e66adb83a"
server_key_version: "encryptionkey@0"
I20260619 06:39:33.643957 20681 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:33.658679 20681 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:33.659583 20681 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:33.659936 20681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:33.660904 20681 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:39:33.662333 20681 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:39:33.662456 20681 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:33.662590 20681 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:39:33.662678 20681 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:33.696682 20681 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:37273
I20260619 06:39:33.696730 20807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:37273 every 8 connection(s)
I20260619 06:39:33.698076 20681 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:39:33.707819 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 20681
I20260619 06:39:33.708014 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:39:33.708585 11009 external_mini_cluster.cc:1428] Setting key d09c086d5034af5ee7360124b55f8b9b
I20260619 06:39:33.711297 20549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:33.700814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:42611 (local address 127.10.192.126:40353)
0619 06:39:33.701031 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:33.701039 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:33.702538 (+ 1499us) server_negotiation.cc:407] Connection header received
0619 06:39:33.704401 (+ 1863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:33.704407 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:33.704503 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:33.704614 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:33.705682 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:33.706412 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:33.708335 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:33.708790 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:33.708903 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:33.710420 (+ 1517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:33.710425 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:33.710429 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:39:33.710451 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:33.710493 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:39:33.710511 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:33.710603 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:33.710875 (+ 272us) server_negotiation.cc:299] Negotiation successful
0619 06:39:33.710972 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260619 06:39:33.712404 20810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:33.701477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:40353 (local address 127.10.192.67:42611)
0619 06:39:33.702366 (+ 889us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:33.702402 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:33.704124 (+ 1722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:33.704853 (+ 729us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:33.704862 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:33.704952 (+ 90us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:33.705518 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:33.705534 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:33.706574 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:33.706578 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:33.708193 (+ 1615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:33.708207 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:33.709017 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:33.709023 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:33.709281 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:33.710031 (+ 750us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:39:33.710036 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:33.710100 (+ 64us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:39:33.710208 (+ 108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:39:33.710623 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:39:33.710633 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:39:33.710641 (+ 8us) client_negotiation.cc:769] Sending connection context
0619 06:39:33.710847 (+ 206us) client_negotiation.cc:240] Negotiation successful
0619 06:39:33.711155 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":262,"threads_started":1}
I20260619 06:39:33.713806 20808 heartbeater.cc:347] Connected to a master server at 127.10.192.126:40353
I20260619 06:39:33.714124 20808 heartbeater.cc:464] Registering TS with master...
I20260619 06:39:33.714959 20808 heartbeater.cc:511] Master 127.10.192.126:40353 requested a full tablet report, sending...
I20260619 06:39:33.716301 20361 ts_manager.cc:194] Registered new tserver with Master: 08e8a26691e342a4ab943ad38c706f49 (127.10.192.67:37273)
I20260619 06:39:33.717259 20361 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.192.67:42611
I20260619 06:39:33.724200 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260619 06:39:33.730383 20549 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:33.728836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41096 (local address 127.10.192.126:40353)
0619 06:39:33.729016 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:33.729020 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:33.729520 (+ 500us) server_negotiation.cc:407] Connection header received
0619 06:39:33.729664 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:33.729668 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:33.729740 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:33.729821 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:33.730178 (+ 357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41096: BlockingRecv error: recv got EOF from 127.0.0.1:41096 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
I20260619 06:39:33.730969 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 20420
I20260619 06:39:33.739162 20817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:33.732034 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55216 (local address 127.10.192.65:38397)
0619 06:39:33.732613 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:33.732629 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:33.732655 (+ 26us) server_negotiation.cc:407] Connection header received
0619 06:39:33.732710 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:33.732717 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:33.732941 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:33.733114 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:33.733524 (+ 410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:33.734505 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:33.735797 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:33.736371 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:33.736520 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:33.737632 (+ 1112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:33.737641 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:33.737654 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:39:33.738307 (+ 653us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:33.738363 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:39:33.738383 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:33.738531 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:33.738675 (+ 144us) server_negotiation.cc:299] Negotiation successful
0619 06:39:33.738812 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":232,"threads_started":1}
I20260619 06:39:33.740540 20542 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:33.823307 20547 heartbeater.cc:503] Master 127.10.192.126:40353 was elected leader, sending a full tablet report...
I20260619 06:39:33.824708 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 20420
W20260619 06:39:33.840766 20345 connection.cc:535] server connection from 127.10.192.65:43965 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 06:39:33.840940 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 20551
I20260619 06:39:33.849192 20819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:33.841818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56614 (local address 127.10.192.66:41011)
0619 06:39:33.842330 (+ 512us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:33.842338 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:33.842365 (+ 27us) server_negotiation.cc:407] Connection header received
0619 06:39:33.842424 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:33.842431 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:33.842660 (+ 229us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:33.842834 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:33.843262 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:33.844311 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:33.845578 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:33.846161 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:33.846308 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:33.847468 (+ 1160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:33.847480 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:33.847495 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:39:33.848344 (+ 849us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:33.848396 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:39:33.848417 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:33.848544 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:33.848679 (+ 135us) server_negotiation.cc:299] Negotiation successful
0619 06:39:33.848829 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":247,"threads_started":1}
I20260619 06:39:33.850570 20673 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:33.932986 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 20551
I20260619 06:39:33.948814 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 20681
I20260619 06:39:33.957151 20821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:33.949729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51098 (local address 127.10.192.67:37273)
0619 06:39:33.950353 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:33.950360 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:33.950391 (+ 31us) server_negotiation.cc:407] Connection header received
0619 06:39:33.950450 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:33.950456 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:33.950711 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:33.950844 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:33.951295 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:33.952486 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:33.953723 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:33.954293 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:33.954423 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:33.955474 (+ 1051us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:33.955483 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:33.955498 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:39:33.956423 (+ 925us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:33.956472 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:39:33.956492 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:33.956595 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:33.956722 (+ 127us) server_negotiation.cc:299] Negotiation successful
0619 06:39:33.956834 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":462,"thread_start_us":315,"threads_started":1}
I20260619 06:39:33.958460 20803 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:34.040596 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 20681
I20260619 06:39:34.058413 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 20330
I20260619 06:39:34.059773 20391 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:34.166807 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 20330
2026-06-19T06:39:34Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (2525 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-06-19T06:39:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:39:34Z Disabled control of system clock
I20260619 06:39:34.239487 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:46733
--webserver_interface=127.10.192.126
--webserver_port=0
--builtin_ntp_servers=127.10.192.84:44919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:46733
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260619 06:39:34.571229 20827 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:34.571547 20827 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:34.571694 20827 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:34.579228 20827 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:39:34.579367 20827 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:34.579407 20827 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:34.579457 20827 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:39:34.579504 20827 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:39:34.589831 20827 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:44919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:46733
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:46733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:34.591274 20827 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:34.593195 20827 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:34.606246 20833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:34.606287 20832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:34.606894 20835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:34.606866 20827 server_base.cc:1034] running on GCE node
I20260619 06:39:34.607964 20827 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:34.609409 20827 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:34.610611 20827 hybrid_clock.cc:648] HybridClock initialized: now 1781851174610561 us; error 43 us; skew 500 ppm
I20260619 06:39:34.610980 20827 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:39:34.613457 20827 webserver.cc:460] Webserver started at http://127.10.192.126:42833/ using document root <none> and password file <none>
I20260619 06:39:34.614219 20827 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:34.614356 20827 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:34.614699 20827 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:34.617759 20827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "3bad72a0316c47ad83ab55bf1898ec51"
format_stamp: "Formatted at 2026-06-19 06:39:34 on dist-test-slave-7lz4"
server_key: "bbbfccf2312c883d29033cdbe549b053"
server_key_iv: "5ad7899bc76cd5ed35c688bfd6a0a0ca"
server_key_version: "encryptionkey@0"
I20260619 06:39:34.618644 20827 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "3bad72a0316c47ad83ab55bf1898ec51"
format_stamp: "Formatted at 2026-06-19 06:39:34 on dist-test-slave-7lz4"
server_key: "bbbfccf2312c883d29033cdbe549b053"
server_key_iv: "5ad7899bc76cd5ed35c688bfd6a0a0ca"
server_key_version: "encryptionkey@0"
I20260619 06:39:34.624086 20827 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.002s
I20260619 06:39:34.627538 20841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:34.629037 20827 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:39:34.629240 20827 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "3bad72a0316c47ad83ab55bf1898ec51"
format_stamp: "Formatted at 2026-06-19 06:39:34 on dist-test-slave-7lz4"
server_key: "bbbfccf2312c883d29033cdbe549b053"
server_key_iv: "5ad7899bc76cd5ed35c688bfd6a0a0ca"
server_key_version: "encryptionkey@0"
I20260619 06:39:34.629489 20827 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:34.635464 20827 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:34.636448 20827 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:34.636788 20827 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:34.655138 20827 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:46733
I20260619 06:39:34.655234 20892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:46733 every 8 connection(s)
I20260619 06:39:34.656636 20827 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:39:34.660514 20893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:34.661746 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 20827
I20260619 06:39:34.661984 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:39:34.662609 11009 external_mini_cluster.cc:1428] Setting key 9195e6d81b06a217032916f1cf639a79
I20260619 06:39:34.671032 20896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:34.664616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35200 (local address 127.10.192.126:46733)
0619 06:39:34.665683 (+ 1067us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:34.665695 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:34.665741 (+ 46us) server_negotiation.cc:407] Connection header received
0619 06:39:34.667276 (+ 1535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:34.667302 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:34.667830 (+ 528us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:34.668160 (+ 330us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:34.669338 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:34.669345 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:34.669358 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:39:34.669378 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:34.669439 (+ 61us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:39:34.669456 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:34.669625 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:34.669767 (+ 142us) server_negotiation.cc:299] Negotiation successful
0619 06:39:34.670072 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":612,"thread_start_us":399,"threads_started":1}
I20260619 06:39:34.674329 20893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51: Bootstrap starting.
I20260619 06:39:34.677640 20893 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:34.678699 20893 log.cc:824] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51: Log is configured to *not* fsync() on all Append() calls
I20260619 06:39:34.681479 20893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51: No bootstrap required, opened a new log
I20260619 06:39:34.689078 20893 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bad72a0316c47ad83ab55bf1898ec51" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 46733 } }
I20260619 06:39:34.689489 20893 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:34.689599 20893 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bad72a0316c47ad83ab55bf1898ec51, State: Initialized, Role: FOLLOWER
I20260619 06:39:34.690284 20893 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bad72a0316c47ad83ab55bf1898ec51" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 46733 } }
I20260619 06:39:34.690531 20893 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:39:34.690675 20893 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:39:34.690865 20893 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:34.693149 20893 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bad72a0316c47ad83ab55bf1898ec51" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 46733 } }
I20260619 06:39:34.693667 20893 leader_election.cc:302] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3bad72a0316c47ad83ab55bf1898ec51; no voters:
I20260619 06:39:34.694376 20893 leader_election.cc:288] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:39:34.694607 20898 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:39:34.695703 20898 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51 [term 1 LEADER]: Becoming Leader. State: Replica: 3bad72a0316c47ad83ab55bf1898ec51, State: Running, Role: LEADER
I20260619 06:39:34.696229 20898 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bad72a0316c47ad83ab55bf1898ec51" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 46733 } }
I20260619 06:39:34.696709 20893 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:39:34.699262 20900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3bad72a0316c47ad83ab55bf1898ec51. Latest consensus state: current_term: 1 leader_uuid: "3bad72a0316c47ad83ab55bf1898ec51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bad72a0316c47ad83ab55bf1898ec51" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 46733 } } }
I20260619 06:39:34.699715 20900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51 [sys.catalog]: This master's current role is: LEADER
I20260619 06:39:34.699685 20899 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3bad72a0316c47ad83ab55bf1898ec51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bad72a0316c47ad83ab55bf1898ec51" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 46733 } } }
I20260619 06:39:34.700349 20899 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51 [sys.catalog]: This master's current role is: LEADER
I20260619 06:39:34.709003 20907 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:39:34.714746 20907 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:39:34.724220 20907 catalog_manager.cc:1347] Generated new cluster ID: 0c3be67a7063429385e68e2af82d0d1d
I20260619 06:39:34.724364 20907 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:39:34.738361 20907 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:39:34.738862 20907 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:39:34.744501 20907 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3bad72a0316c47ad83ab55bf1898ec51: Generated new TSK 0
I20260619 06:39:34.745424 20907 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:39:34.756007 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:46733
--builtin_ntp_servers=127.10.192.84:44919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260619 06:39:35.108418 20917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:35.108729 20917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:35.108896 20917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:35.116318 20917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:35.116451 20917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:35.116658 20917 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:39:35.126173 20917 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:44919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:46733
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:35.127656 20917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:35.129599 20917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:35.144161 20925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:35.144194 20922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:35.144229 20923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:35.145038 20917 server_base.cc:1034] running on GCE node
I20260619 06:39:35.145735 20917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:35.146775 20917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:35.147981 20917 hybrid_clock.cc:648] HybridClock initialized: now 1781851175147924 us; error 49 us; skew 500 ppm
I20260619 06:39:35.148332 20917 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:39:35.150698 20917 webserver.cc:460] Webserver started at http://127.10.192.65:36419/ using document root <none> and password file <none>
I20260619 06:39:35.151448 20917 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:35.151562 20917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:35.151968 20917 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:35.156605 20917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "03ecdb322d554b6483b34244edd07fe9"
format_stamp: "Formatted at 2026-06-19 06:39:35 on dist-test-slave-7lz4"
server_key: "3dc0ade6e21c0d4aa4a61275a3221730"
server_key_iv: "a96d0a8f89f7aa7548c46508058b89fa"
server_key_version: "encryptionkey@0"
I20260619 06:39:35.157441 20917 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "03ecdb322d554b6483b34244edd07fe9"
format_stamp: "Formatted at 2026-06-19 06:39:35 on dist-test-slave-7lz4"
server_key: "3dc0ade6e21c0d4aa4a61275a3221730"
server_key_iv: "a96d0a8f89f7aa7548c46508058b89fa"
server_key_version: "encryptionkey@0"
I20260619 06:39:35.162788 20917 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 06:39:35.166445 20931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:35.167958 20917 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:39:35.168143 20917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "03ecdb322d554b6483b34244edd07fe9"
format_stamp: "Formatted at 2026-06-19 06:39:35 on dist-test-slave-7lz4"
server_key: "3dc0ade6e21c0d4aa4a61275a3221730"
server_key_iv: "a96d0a8f89f7aa7548c46508058b89fa"
server_key_version: "encryptionkey@0"
I20260619 06:39:35.168381 20917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:35.174458 20917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:35.175292 20917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:35.175576 20917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:35.176553 20917 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:39:35.177946 20917 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:39:35.178095 20917 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:35.178220 20917 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:39:35.178310 20917 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:35.212782 20917 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:35045
I20260619 06:39:35.212834 21043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:35045 every 8 connection(s)
I20260619 06:39:35.214257 20917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:39:35.222553 21046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:35.216819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:49575 (local address 127.10.192.126:46733)
0619 06:39:35.217263 (+ 444us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:35.217269 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:35.218372 (+ 1103us) server_negotiation.cc:407] Connection header received
0619 06:39:35.220138 (+ 1766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:35.220143 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:35.220220 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:35.220341 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:35.221739 (+ 1398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:35.221745 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:35.221750 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:39:35.221772 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:35.221820 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:39:35.221833 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:35.221979 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:35.222162 (+ 183us) server_negotiation.cc:299] Negotiation successful
0619 06:39:35.222256 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":340,"thread_start_us":241,"threads_started":1}
I20260619 06:39:35.222797 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 20917
I20260619 06:39:35.223047 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:39:35.223691 21047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:35.217309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:46733 (local address 127.10.192.65:49575)
0619 06:39:35.218212 (+ 903us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:35.218247 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:35.219862 (+ 1615us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:35.220595 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:35.220604 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:35.220704 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:35.221431 (+ 727us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:39:35.221433 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:35.221472 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:39:35.221561 (+ 89us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:39:35.221938 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:39:35.221948 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:39:35.221957 (+ 9us) client_negotiation.cc:769] Sending connection context
0619 06:39:35.222249 (+ 292us) client_negotiation.cc:240] Negotiation successful
0619 06:39:35.222528 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":428,"thread_start_us":259,"threads_started":1}
I20260619 06:39:35.223737 11009 external_mini_cluster.cc:1428] Setting key 17ea87ccc83627608e8c385f89083d1a
I20260619 06:39:35.225471 21044 heartbeater.cc:347] Connected to a master server at 127.10.192.126:46733
I20260619 06:39:35.225781 21044 heartbeater.cc:464] Registering TS with master...
I20260619 06:39:35.226352 21044 heartbeater.cc:511] Master 127.10.192.126:46733 requested a full tablet report, sending...
I20260619 06:39:35.226923 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:46733
--builtin_ntp_servers=127.10.192.84:44919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260619 06:39:35.228682 20857 ts_manager.cc:194] Registered new tserver with Master: 03ecdb322d554b6483b34244edd07fe9 (127.10.192.65:35045)
W20260619 06:39:35.556749 21048 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:35.557135 21048 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:35.557312 21048 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:35.564661 21048 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:35.564841 21048 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:35.565039 21048 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:39:35.574510 21048 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:44919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:46733
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:35.575914 21048 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:35.577744 21048 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:35.591763 21056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:35.591693 21054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:35.591713 21053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:35.592761 21048 server_base.cc:1034] running on GCE node
I20260619 06:39:35.593454 21048 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:35.594532 21048 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:35.595759 21048 hybrid_clock.cc:648] HybridClock initialized: now 1781851175595695 us; error 87 us; skew 500 ppm
I20260619 06:39:35.596117 21048 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:39:35.598573 21048 webserver.cc:460] Webserver started at http://127.10.192.66:45317/ using document root <none> and password file <none>
I20260619 06:39:35.599311 21048 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:35.599449 21048 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:35.599850 21048 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:35.602921 21048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "4e541543cc234e3381c4da9423bcf34c"
format_stamp: "Formatted at 2026-06-19 06:39:35 on dist-test-slave-7lz4"
server_key: "a8d962b51b71ce0c4520140a7d0d08ee"
server_key_iv: "d48a73b95a9ecbb03cbfe063681e526e"
server_key_version: "encryptionkey@0"
I20260619 06:39:35.603850 21048 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "4e541543cc234e3381c4da9423bcf34c"
format_stamp: "Formatted at 2026-06-19 06:39:35 on dist-test-slave-7lz4"
server_key: "a8d962b51b71ce0c4520140a7d0d08ee"
server_key_iv: "d48a73b95a9ecbb03cbfe063681e526e"
server_key_version: "encryptionkey@0"
I20260619 06:39:35.609287 21048 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 06:39:35.612958 21062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:35.614445 21048 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:39:35.614647 21048 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "4e541543cc234e3381c4da9423bcf34c"
format_stamp: "Formatted at 2026-06-19 06:39:35 on dist-test-slave-7lz4"
server_key: "a8d962b51b71ce0c4520140a7d0d08ee"
server_key_iv: "d48a73b95a9ecbb03cbfe063681e526e"
server_key_version: "encryptionkey@0"
I20260619 06:39:35.614898 21048 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:35.620962 21048 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:35.621862 21048 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:35.622164 21048 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:35.623121 21048 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:39:35.624668 21048 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:39:35.624797 21048 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:35.624923 21048 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:39:35.625025 21048 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:35.660154 21048 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:37275
I20260619 06:39:35.660188 21174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:37275 every 8 connection(s)
I20260619 06:39:35.661583 21048 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:39:35.671486 21046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:35.664460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:48707 (local address 127.10.192.126:46733)
0619 06:39:35.664667 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:35.664673 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:35.666414 (+ 1741us) server_negotiation.cc:407] Connection header received
0619 06:39:35.668894 (+ 2480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:35.668899 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:35.668958 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:35.669041 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:35.670641 (+ 1600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:35.670646 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:35.670649 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:39:35.670667 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:35.670698 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:39:35.670711 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:35.670811 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:35.671042 (+ 231us) server_negotiation.cc:299] Negotiation successful
0619 06:39:35.671133 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 06:39:35.671525 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 21048
I20260619 06:39:35.671726 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:39:35.672242 11009 external_mini_cluster.cc:1428] Setting key 82f3489f315be4266f0a3e20572722c4
I20260619 06:39:35.672897 21177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:35.665052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:46733 (local address 127.10.192.66:48707)
0619 06:39:35.666216 (+ 1164us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:35.666270 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:35.668555 (+ 2285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:35.669352 (+ 797us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:35.669367 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:35.669511 (+ 144us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:35.670251 (+ 740us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:39:35.670255 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:35.670307 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:39:35.670434 (+ 127us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:39:35.670822 (+ 388us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:39:35.670833 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:39:35.670842 (+ 9us) client_negotiation.cc:769] Sending connection context
0619 06:39:35.671151 (+ 309us) client_negotiation.cc:240] Negotiation successful
0619 06:39:35.671446 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":331,"threads_started":1}
I20260619 06:39:35.674430 21175 heartbeater.cc:347] Connected to a master server at 127.10.192.126:46733
I20260619 06:39:35.674783 21175 heartbeater.cc:464] Registering TS with master...
I20260619 06:39:35.675411 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:46733
--builtin_ntp_servers=127.10.192.84:44919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260619 06:39:35.675429 21175 heartbeater.cc:511] Master 127.10.192.126:46733 requested a full tablet report, sending...
I20260619 06:39:35.677003 20857 ts_manager.cc:194] Registered new tserver with Master: 4e541543cc234e3381c4da9423bcf34c (127.10.192.66:37275)
W20260619 06:39:36.021724 21178 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:36.022014 21178 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:36.022171 21178 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:36.029592 21178 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:36.029706 21178 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:36.029888 21178 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:39:36.039417 21178 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:44919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:46733
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:36.040788 21178 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:36.042605 21178 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:36.056308 21184 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:36.056346 21186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:36.056504 21183 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:36.057179 21178 server_base.cc:1034] running on GCE node
I20260619 06:39:36.057947 21178 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:36.058944 21178 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:36.060180 21178 hybrid_clock.cc:648] HybridClock initialized: now 1781851176060137 us; error 66 us; skew 500 ppm
I20260619 06:39:36.060560 21178 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:39:36.064630 21178 webserver.cc:460] Webserver started at http://127.10.192.67:39489/ using document root <none> and password file <none>
I20260619 06:39:36.065554 21178 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:36.065683 21178 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:36.066011 21178 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:36.069036 21178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "ec3159bc2d454558b05133b3e8a38dac"
format_stamp: "Formatted at 2026-06-19 06:39:36 on dist-test-slave-7lz4"
server_key: "4499c19ebe76f598d1bd3a805c863b58"
server_key_iv: "890771618088b1fcb95fed3117b94904"
server_key_version: "encryptionkey@0"
I20260619 06:39:36.069866 21178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "ec3159bc2d454558b05133b3e8a38dac"
format_stamp: "Formatted at 2026-06-19 06:39:36 on dist-test-slave-7lz4"
server_key: "4499c19ebe76f598d1bd3a805c863b58"
server_key_iv: "890771618088b1fcb95fed3117b94904"
server_key_version: "encryptionkey@0"
I20260619 06:39:36.075368 21178 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260619 06:39:36.079077 21192 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:36.080646 21178 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:39:36.080855 21178 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "ec3159bc2d454558b05133b3e8a38dac"
format_stamp: "Formatted at 2026-06-19 06:39:36 on dist-test-slave-7lz4"
server_key: "4499c19ebe76f598d1bd3a805c863b58"
server_key_iv: "890771618088b1fcb95fed3117b94904"
server_key_version: "encryptionkey@0"
I20260619 06:39:36.081110 21178 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:36.087195 21178 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:36.088109 21178 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:36.088428 21178 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:36.089404 21178 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:39:36.090888 21178 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:39:36.091015 21178 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:36.091140 21178 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:39:36.091225 21178 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:36.125002 21178 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:44463
I20260619 06:39:36.125056 21304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:44463 every 8 connection(s)
I20260619 06:39:36.126358 21178 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:39:36.129231 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 21178
I20260619 06:39:36.129405 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:39:36.129809 11009 external_mini_cluster.cc:1428] Setting key 6eb3ebb4945cdfb2fb9710aa76ac1172
I20260619 06:39:36.135335 21046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:36.129008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:59231 (local address 127.10.192.126:46733)
0619 06:39:36.129211 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:36.129217 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:36.131054 (+ 1837us) server_negotiation.cc:407] Connection header received
0619 06:39:36.133149 (+ 2095us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:36.133153 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:36.133214 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:36.133294 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:36.134619 (+ 1325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:36.134623 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:36.134627 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:39:36.134642 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:36.134672 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:39:36.134683 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:36.134772 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:36.135073 (+ 301us) server_negotiation.cc:299] Negotiation successful
0619 06:39:36.135125 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260619 06:39:36.136466 21307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:36.129719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:46733 (local address 127.10.192.67:59231)
0619 06:39:36.130896 (+ 1177us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:36.130941 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:36.132790 (+ 1849us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:36.133512 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:36.133521 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:36.133619 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:36.134322 (+ 703us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:39:36.134324 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:36.134361 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:39:36.134460 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:39:36.134811 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:39:36.134820 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:39:36.134827 (+ 7us) client_negotiation.cc:769] Sending connection context
0619 06:39:36.135107 (+ 280us) client_negotiation.cc:240] Negotiation successful
0619 06:39:36.135334 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"thread_start_us":358,"threads_started":1}
I20260619 06:39:36.137835 21305 heartbeater.cc:347] Connected to a master server at 127.10.192.126:46733
I20260619 06:39:36.138141 21305 heartbeater.cc:464] Registering TS with master...
I20260619 06:39:36.138751 21305 heartbeater.cc:511] Master 127.10.192.126:46733 requested a full tablet report, sending...
I20260619 06:39:36.140256 20857 ts_manager.cc:194] Registered new tserver with Master: ec3159bc2d454558b05133b3e8a38dac (127.10.192.67:44463)
I20260619 06:39:36.145486 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260619 06:39:36.151418 21046 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:39:36.150058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35206 (local address 127.10.192.126:46733)
0619 06:39:36.150220 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:36.150224 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:36.150688 (+ 464us) server_negotiation.cc:407] Connection header received
0619 06:39:36.150810 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:36.150814 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:36.150866 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:36.150955 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:36.151229 (+ 274us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35206: BlockingRecv error: recv got EOF from 127.0.0.1:35206 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260619 06:39:36.151928 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 20917
I20260619 06:39:36.155510 21314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:36.153066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38480 (local address 127.10.192.65:35045)
0619 06:39:36.153579 (+ 513us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:36.153586 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:36.153613 (+ 27us) server_negotiation.cc:407] Connection header received
0619 06:39:36.153676 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:36.153682 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:36.153891 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:36.154016 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:36.154865 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:36.154871 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:36.154882 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:39:36.154894 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:36.154937 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:39:36.154953 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:36.155058 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:36.155100 (+ 42us) server_negotiation.cc:299] Negotiation successful
0619 06:39:36.155216 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":368,"thread_start_us":237,"threads_started":1}
I20260619 06:39:36.156793 21039 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:36.238274 21044 heartbeater.cc:503] Master 127.10.192.126:46733 was elected leader, sending a full tablet report...
I20260619 06:39:36.246877 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 20917
W20260619 06:39:36.262953 20845 connection.cc:535] server connection from 127.10.192.65:49575 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 06:39:36.263280 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 21048
I20260619 06:39:36.267042 21316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:36.264350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38000 (local address 127.10.192.66:37275)
0619 06:39:36.264939 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:36.264946 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:36.264972 (+ 26us) server_negotiation.cc:407] Connection header received
0619 06:39:36.265034 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:36.265040 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:36.265266 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:36.265412 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:36.266335 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:36.266341 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:36.266353 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:39:36.266373 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:36.266417 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:39:36.266432 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:36.266535 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:36.266642 (+ 107us) server_negotiation.cc:299] Negotiation successful
0619 06:39:36.266761 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":286,"threads_started":1}
I20260619 06:39:36.268404 21170 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:36.349597 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 21048
I20260619 06:39:36.366942 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 21178
I20260619 06:39:36.371076 21318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:36.368059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34174 (local address 127.10.192.67:44463)
0619 06:39:36.368672 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:36.368679 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:36.368709 (+ 30us) server_negotiation.cc:407] Connection header received
0619 06:39:36.368768 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:36.368773 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:36.369001 (+ 228us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:36.369175 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:36.370346 (+ 1171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:36.370353 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:36.370364 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:39:36.370380 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:36.370418 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:39:36.370431 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:36.370612 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:36.370684 (+ 72us) server_negotiation.cc:299] Negotiation successful
0619 06:39:36.370783 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":477,"thread_start_us":319,"threads_started":1}
I20260619 06:39:36.372450 21300 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:36.455233 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 21178
I20260619 06:39:36.471465 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 20827
I20260619 06:39:36.472788 20888 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:36.573570 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 20827
2026-06-19T06:39:36Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (2407 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:39:36 dist-test-slave-7lz4 krb5kdc[21323](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:39:36 dist-test-slave-7lz4 krb5kdc[21323](info): set up 2 sockets
Jun 19 06:39:36 dist-test-slave-7lz4 krb5kdc[21323](info): commencing operation
krb5kdc: starting...
W20260619 06:39:37.672539 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.058s user 0.004s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:39:37 dist-test-slave-7lz4 krb5kdc[21323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:39:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:39:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:39:37.910677 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:36825
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:41135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:36825
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:39:38.244993 21336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:38.245376 21336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:38.245534 21336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:38.252946 21336 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:39:38.253119 21336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:38.253242 21336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:38.253340 21336 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:39:38.253427 21336 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:39:38.263595 21336 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:41135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:36825
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:36825
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:38.265085 21336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:38.266883 21336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:38.278995 21341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:38.279052 21342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:38.279021 21344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:38.280050 21336 server_base.cc:1034] running on GCE node
I20260619 06:39:38.280833 21336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:38.282253 21336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:38.283468 21336 hybrid_clock.cc:648] HybridClock initialized: now 1781851178283427 us; error 34 us; skew 500 ppm
I20260619 06:39:38.283842 21336 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:39:38 dist-test-slave-7lz4 krb5kdc[21323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851178, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:39:38.290827 21336 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:39:38.292403 21336 webserver.cc:460] Webserver started at http://127.10.192.126:44337/ using document root <none> and password file <none>
I20260619 06:39:38.293107 21336 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:38.293248 21336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:38.293562 21336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:38.296675 21336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "b1c53ba839344228b178a447a9aec6fe"
format_stamp: "Formatted at 2026-06-19 06:39:38 on dist-test-slave-7lz4"
server_key: "54748f956b89fc6c959c16a753153863"
server_key_iv: "396b0807f058632cd3a5e56b52bcfe7f"
server_key_version: "encryptionkey@0"
I20260619 06:39:38.297473 21336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "b1c53ba839344228b178a447a9aec6fe"
format_stamp: "Formatted at 2026-06-19 06:39:38 on dist-test-slave-7lz4"
server_key: "54748f956b89fc6c959c16a753153863"
server_key_iv: "396b0807f058632cd3a5e56b52bcfe7f"
server_key_version: "encryptionkey@0"
I20260619 06:39:38.302990 21336 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 06:39:38.306525 21351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:38.307933 21336 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 06:39:38.308120 21336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "b1c53ba839344228b178a447a9aec6fe"
format_stamp: "Formatted at 2026-06-19 06:39:38 on dist-test-slave-7lz4"
server_key: "54748f956b89fc6c959c16a753153863"
server_key_iv: "396b0807f058632cd3a5e56b52bcfe7f"
server_key_version: "encryptionkey@0"
I20260619 06:39:38.308322 21336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:38.355096 21336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:38.359103 21336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:38.359414 21336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:38.378353 21336 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:36825
I20260619 06:39:38.378381 21402 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:36825 every 8 connection(s)
I20260619 06:39:38.379853 21336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:39:38.383559 21403 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:38.384200 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 21336
I20260619 06:39:38.384429 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:39:38.385262 11009 external_mini_cluster.cc:1428] Setting key 7e5ea5bf41a3d646bfb63c8d793f1249
I20260619 06:39:38.396320 21403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe: Bootstrap starting.
Jun 19 06:39:38 dist-test-slave-7lz4 krb5kdc[21323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:39:38.399519 21403 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:38.400576 21403 log.cc:824] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe: Log is configured to *not* fsync() on all Append() calls
I20260619 06:39:38.404104 21403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe: No bootstrap required, opened a new log
I20260619 06:39:38.408798 21406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:38.387545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36374 (local address 127.10.192.126:36825)
0619 06:39:38.388294 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:38.388305 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:38.388355 (+ 50us) server_negotiation.cc:407] Connection header received
0619 06:39:38.390172 (+ 1817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:38.390196 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:38.390632 (+ 436us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:38.391089 (+ 457us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:38.392614 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:38.393916 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:38.395153 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:38.395891 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:38.396096 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:38.400223 (+ 4127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:38.400231 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:38.400246 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:38.400284 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:38.404113 (+ 3829us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:38.404865 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:38.404875 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:38.404884 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:38.405085 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:38.405455 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:38.405460 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:38.405465 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:38.406200 (+ 735us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:38.406517 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:38.406866 (+ 349us) server_negotiation.cc:299] Negotiation successful
0619 06:39:38.407345 (+ 479us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":548,"thread_start_us":314,"threads_started":1}
I20260619 06:39:38.413866 21403 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1c53ba839344228b178a447a9aec6fe" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 36825 } }
I20260619 06:39:38.414199 21403 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:38.414263 21403 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1c53ba839344228b178a447a9aec6fe, State: Initialized, Role: FOLLOWER
I20260619 06:39:38.414749 21403 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1c53ba839344228b178a447a9aec6fe" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 36825 } }
I20260619 06:39:38.414945 21403 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:39:38.415047 21403 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:39:38.415167 21403 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:38.417862 21403 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1c53ba839344228b178a447a9aec6fe" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 36825 } }
I20260619 06:39:38.418417 21403 leader_election.cc:302] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1c53ba839344228b178a447a9aec6fe; no voters:
I20260619 06:39:38.418929 21403 leader_election.cc:288] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:39:38.419070 21408 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:39:38.419795 21408 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe [term 1 LEADER]: Becoming Leader. State: Replica: b1c53ba839344228b178a447a9aec6fe, State: Running, Role: LEADER
I20260619 06:39:38.420497 21408 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1c53ba839344228b178a447a9aec6fe" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 36825 } }
I20260619 06:39:38.421325 21403 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:39:38.423288 21410 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1c53ba839344228b178a447a9aec6fe. Latest consensus state: current_term: 1 leader_uuid: "b1c53ba839344228b178a447a9aec6fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1c53ba839344228b178a447a9aec6fe" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 36825 } } }
I20260619 06:39:38.423295 21409 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1c53ba839344228b178a447a9aec6fe" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1c53ba839344228b178a447a9aec6fe" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 36825 } } }
I20260619 06:39:38.423729 21410 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe [sys.catalog]: This master's current role is: LEADER
I20260619 06:39:38.423870 21409 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe [sys.catalog]: This master's current role is: LEADER
I20260619 06:39:38.424655 21413 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:39:38.430575 21413 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:39:38.441671 21413 catalog_manager.cc:1347] Generated new cluster ID: 08da5ce4cdb543e0a6f37f4e08b9136f
I20260619 06:39:38.441814 21413 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:39:38.450721 21413 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:39:38.452131 21413 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:39:38.460260 21413 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe: Generated new TSK 0
I20260619 06:39:38.461429 21413 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
I20260619 06:39:38.523293 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:36825
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:41135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:39:38.862290 21429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:38.862692 21429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:38.862838 21429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:38.870203 21429 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:38.870324 21429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:38.870451 21429 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:39:38.880363 21429 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:41135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:36825
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:38.881695 21429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:38.883050 21429 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:38.896747 21434 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:38.896709 21435 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:38.896777 21437 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:38.897953 21429 server_base.cc:1034] running on GCE node
I20260619 06:39:38.898633 21429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:38.899701 21429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:38.900939 21429 hybrid_clock.cc:648] HybridClock initialized: now 1781851178900872 us; error 71 us; skew 500 ppm
I20260619 06:39:38.901279 21429 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:39:38 dist-test-slave-7lz4 krb5kdc[21323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851178, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:39:38.904486 21429 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:39:38.906054 21429 webserver.cc:460] Webserver started at http://127.10.192.65:34417/ using document root <none> and password file <none>
I20260619 06:39:38.906772 21429 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:38.906915 21429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:38.907218 21429 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:38.910200 21429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "c769d81762d74918ae30392f5b99a50f"
format_stamp: "Formatted at 2026-06-19 06:39:38 on dist-test-slave-7lz4"
server_key: "c8e72570e6e5fd6df8bf9052da2301a9"
server_key_iv: "faa650d74332b15be0972d568f6776d2"
server_key_version: "encryptionkey@0"
I20260619 06:39:38.911083 21429 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "c769d81762d74918ae30392f5b99a50f"
format_stamp: "Formatted at 2026-06-19 06:39:38 on dist-test-slave-7lz4"
server_key: "c8e72570e6e5fd6df8bf9052da2301a9"
server_key_iv: "faa650d74332b15be0972d568f6776d2"
server_key_version: "encryptionkey@0"
I20260619 06:39:38.916673 21429 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260619 06:39:38.920269 21444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:38.921701 21429 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:39:38.921907 21429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "c769d81762d74918ae30392f5b99a50f"
format_stamp: "Formatted at 2026-06-19 06:39:38 on dist-test-slave-7lz4"
server_key: "c8e72570e6e5fd6df8bf9052da2301a9"
server_key_iv: "faa650d74332b15be0972d568f6776d2"
server_key_version: "encryptionkey@0"
I20260619 06:39:38.922137 21429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:38.936671 21429 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:38.941198 21429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:38.941521 21429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:38.942584 21429 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:39:38.944049 21429 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:39:38.944154 21429 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:38.944300 21429 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:39:38.944377 21429 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:38.977854 21429 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:35203
I20260619 06:39:38.977948 21556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:35203 every 8 connection(s)
I20260619 06:39:38.979223 21429 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:39:38.986814 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 21429
I20260619 06:39:38.987085 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:39:38.987841 11009 external_mini_cluster.cc:1428] Setting key e2cd0f5acccfd747d295ba78f0092b83
Jun 19 06:39:38 dist-test-slave-7lz4 krb5kdc[21323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851178, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:39:39.002213 21559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:38.982067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:43591 (local address 127.10.192.126:36825)
0619 06:39:38.982533 (+ 466us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:38.982537 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:38.983594 (+ 1057us) server_negotiation.cc:407] Connection header received
0619 06:39:38.985397 (+ 1803us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:38.985401 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:38.985474 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:38.985572 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:38.987509 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:38.988319 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:38.990010 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:38.990396 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:38.990505 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:38.994735 (+ 4230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:38.994745 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:38.994753 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:38.994797 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:38.998440 (+ 3643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:38.999454 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:38.999459 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:38.999462 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:38.999602 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:39.000184 (+ 582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:39.000192 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:39.000195 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:39.000529 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:39.000693 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:39.001520 (+ 827us) server_negotiation.cc:299] Negotiation successful
0619 06:39:39.001775 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":242,"threads_started":1}
I20260619 06:39:39.003213 21560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:38.982668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:36825 (local address 127.10.192.65:43591)
0619 06:39:38.983425 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:38.983465 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:38.985142 (+ 1677us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:38.985797 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:38.985806 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:38.986388 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:38.987288 (+ 900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:38.987316 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:38.988487 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:38.988491 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:38.989826 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:38.989841 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:38.990640 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:38.990650 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:38.990987 (+ 337us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:38.991782 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:38.991819 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:38.994499 (+ 2680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:39:38.998604 (+ 4105us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:38.998619 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:38.998641 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:38.999311 (+ 670us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:38.999783 (+ 472us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:38.999792 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:38.999796 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:39.000051 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:39.000680 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:39:39.000689 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:39:39.001098 (+ 409us) client_negotiation.cc:769] Sending connection context
0619 06:39:39.001407 (+ 309us) client_negotiation.cc:240] Negotiation successful
0619 06:39:39.001983 (+ 576us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":268,"threads_started":1}
I20260619 06:39:39.005021 21557 heartbeater.cc:347] Connected to a master server at 127.10.192.126:36825
I20260619 06:39:39.005407 21557 heartbeater.cc:464] Registering TS with master...
I20260619 06:39:39.006235 21557 heartbeater.cc:511] Master 127.10.192.126:36825 requested a full tablet report, sending...
I20260619 06:39:39.008709 21368 ts_manager.cc:194] Registered new tserver with Master: c769d81762d74918ae30392f5b99a50f (127.10.192.65:35203)
I20260619 06:39:39.010290 21368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:43591
WARNING: no policy specified for kudu/127.10.192.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
I20260619 06:39:39.042299 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:36825
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:41135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:39:39.373515 21563 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:39.373795 21563 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:39.373997 21563 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:39.381387 21563 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:39.381569 21563 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:39.381748 21563 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:39:39.391585 21563 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:41135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:36825
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:39.392951 21563 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:39.394292 21563 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:39.407541 21568 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:39.407655 21571 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:39.407689 21569 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:39.408656 21563 server_base.cc:1034] running on GCE node
I20260619 06:39:39.409293 21563 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:39.410264 21563 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:39.411523 21563 hybrid_clock.cc:648] HybridClock initialized: now 1781851179411445 us; error 66 us; skew 500 ppm
I20260619 06:39:39.411965 21563 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:39:39 dist-test-slave-7lz4 krb5kdc[21323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851179, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:39:39.415330 21563 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:39:39.416836 21563 webserver.cc:460] Webserver started at http://127.10.192.66:35663/ using document root <none> and password file <none>
I20260619 06:39:39.417507 21563 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:39.417603 21563 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:39.417848 21563 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:39.420885 21563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "2679633876754202a03126592a3cf634"
format_stamp: "Formatted at 2026-06-19 06:39:39 on dist-test-slave-7lz4"
server_key: "8bab9d10660684ea889f4e6a658de36b"
server_key_iv: "e45ea3937dd09b88ecc6a9c4cffc2a7b"
server_key_version: "encryptionkey@0"
I20260619 06:39:39.421689 21563 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "2679633876754202a03126592a3cf634"
format_stamp: "Formatted at 2026-06-19 06:39:39 on dist-test-slave-7lz4"
server_key: "8bab9d10660684ea889f4e6a658de36b"
server_key_iv: "e45ea3937dd09b88ecc6a9c4cffc2a7b"
server_key_version: "encryptionkey@0"
I20260619 06:39:39.427295 21563 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 06:39:39.430912 21578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:39.432399 21563 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260619 06:39:39.432533 21563 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "2679633876754202a03126592a3cf634"
format_stamp: "Formatted at 2026-06-19 06:39:39 on dist-test-slave-7lz4"
server_key: "8bab9d10660684ea889f4e6a658de36b"
server_key_iv: "e45ea3937dd09b88ecc6a9c4cffc2a7b"
server_key_version: "encryptionkey@0"
I20260619 06:39:39.432706 21563 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:39.458245 21563 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:39.462759 21563 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:39.463079 21563 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:39.464144 21563 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:39:39.465499 21563 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:39:39.465571 21563 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:39.465730 21563 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:39:39.465780 21563 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:39.497210 21563 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:34945
I20260619 06:39:39.497243 21690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:34945 every 8 connection(s)
I20260619 06:39:39.498549 21563 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:39:39.504930 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 21563
I20260619 06:39:39.505122 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:39:39.505541 11009 external_mini_cluster.cc:1428] Setting key a181b73a4c2caec0a2b564404fa7c941
Jun 19 06:39:39 dist-test-slave-7lz4 krb5kdc[21323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851179, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:39:39.519547 21559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:39.501126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:41933 (local address 127.10.192.126:36825)
0619 06:39:39.501334 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:39.501340 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:39.502616 (+ 1276us) server_negotiation.cc:407] Connection header received
0619 06:39:39.504423 (+ 1807us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:39.504428 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:39.504497 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:39.504643 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:39.506368 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:39.507279 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:39.508964 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:39.509391 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:39.509535 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:39.513130 (+ 3595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:39.513142 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:39.513145 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:39.513179 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:39.516369 (+ 3190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:39.517156 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:39.517162 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:39.517166 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:39.517304 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:39.517755 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:39.517760 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:39.517763 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:39.518063 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:39.518220 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:39.518959 (+ 739us) server_negotiation.cc:299] Negotiation successful
0619 06:39:39.519190 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260619 06:39:39.520615 21693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:39.501731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:36825 (local address 127.10.192.66:41933)
0619 06:39:39.502456 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:39.502497 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:39.504154 (+ 1657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:39.504832 (+ 678us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:39.504840 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:39.505477 (+ 637us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:39.506177 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:39.506206 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:39.507433 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:39.507438 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:39.508806 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:39.508818 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:39.509623 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:39.509630 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:39.509863 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:39.510597 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:39.510621 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:39.512877 (+ 2256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:39:39.516536 (+ 3659us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:39.516546 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:39.516567 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:39.517018 (+ 451us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:39.517419 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:39.517424 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:39.517428 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:39.517631 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:39.518200 (+ 569us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:39:39.518209 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:39:39.518570 (+ 361us) client_negotiation.cc:769] Sending connection context
0619 06:39:39.518848 (+ 278us) client_negotiation.cc:240] Negotiation successful
0619 06:39:39.519421 (+ 573us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"thread_start_us":272,"threads_started":1}
I20260619 06:39:39.522261 21691 heartbeater.cc:347] Connected to a master server at 127.10.192.126:36825
I20260619 06:39:39.522621 21691 heartbeater.cc:464] Registering TS with master...
I20260619 06:39:39.523373 21691 heartbeater.cc:511] Master 127.10.192.126:36825 requested a full tablet report, sending...
I20260619 06:39:39.525012 21368 ts_manager.cc:194] Registered new tserver with Master: 2679633876754202a03126592a3cf634 (127.10.192.66:34945)
I20260619 06:39:39.525903 21368 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:41933
WARNING: no policy specified for kudu/127.10.192.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
I20260619 06:39:39.558665 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:36825
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:41135
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:39:39.888098 21696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:39:39.888473 21696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:39:39.888653 21696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:39:39.896160 21696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:39:39.896337 21696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:39:39.896521 21696 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:39:39.906543 21696 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:41135
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:36825
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:39:39.908017 21696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:39:39.909365 21696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:39:39.923209 21704 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:39.923267 21701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:39:39.923267 21702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:39:39.924052 21696 server_base.cc:1034] running on GCE node
I20260619 06:39:39.924693 21696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:39:39.925706 21696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:39:39.926956 21696 hybrid_clock.cc:648] HybridClock initialized: now 1781851179926916 us; error 37 us; skew 500 ppm
I20260619 06:39:39.927317 21696 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:39:39 dist-test-slave-7lz4 krb5kdc[21323](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851179, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:39:39.930802 21696 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:39:39.932375 21696 webserver.cc:460] Webserver started at http://127.10.192.67:35609/ using document root <none> and password file <none>
I20260619 06:39:39.933089 21696 fs_manager.cc:359] Metadata directory not provided
I20260619 06:39:39.933192 21696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:39:39.933444 21696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:39:39.936655 21696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "076d21b528e34da89048f26e04facdb0"
format_stamp: "Formatted at 2026-06-19 06:39:39 on dist-test-slave-7lz4"
server_key: "2f1ec79d9594f27bc3c77ba5466b9665"
server_key_iv: "4117d3e46d2a066556d9b35d1041a382"
server_key_version: "encryptionkey@0"
I20260619 06:39:39.937451 21696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "076d21b528e34da89048f26e04facdb0"
format_stamp: "Formatted at 2026-06-19 06:39:39 on dist-test-slave-7lz4"
server_key: "2f1ec79d9594f27bc3c77ba5466b9665"
server_key_iv: "4117d3e46d2a066556d9b35d1041a382"
server_key_version: "encryptionkey@0"
I20260619 06:39:39.942816 21696 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 06:39:39.946362 21711 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:39.947861 21696 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:39:39.948040 21696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "076d21b528e34da89048f26e04facdb0"
format_stamp: "Formatted at 2026-06-19 06:39:39 on dist-test-slave-7lz4"
server_key: "2f1ec79d9594f27bc3c77ba5466b9665"
server_key_iv: "4117d3e46d2a066556d9b35d1041a382"
server_key_version: "encryptionkey@0"
I20260619 06:39:39.948215 21696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:39:39.965552 21696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:39:39.969760 21696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:39:39.970080 21696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:39:39.971050 21696 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:39:39.972493 21696 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:39:39.972564 21696 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:39.972712 21696 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:39:39.972761 21696 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:39:40.006878 21696 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:38491
I20260619 06:39:40.006928 21823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:38491 every 8 connection(s)
I20260619 06:39:40.008324 21696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:39:40.011615 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 21696
I20260619 06:39:40.011857 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:39:40.012483 11009 external_mini_cluster.cc:1428] Setting key 0534edb7bfbed851e9ed518f6c41bc4f
I20260619 06:39:40.013752 21557 heartbeater.cc:503] Master 127.10.192.126:36825 was elected leader, sending a full tablet report...
Jun 19 06:39:40 dist-test-slave-7lz4 krb5kdc[21323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851179, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:39:40.030898 21559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:40.010978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:41225 (local address 127.10.192.126:36825)
0619 06:39:40.011164 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:40.011169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:40.012737 (+ 1568us) server_negotiation.cc:407] Connection header received
0619 06:39:40.015253 (+ 2516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:40.015258 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:40.015344 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:40.015455 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:40.017626 (+ 2171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.018354 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.020205 (+ 1851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.020613 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.020709 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:40.024665 (+ 3956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:40.024670 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:40.024673 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:40.024704 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:40.027617 (+ 2913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:40.028610 (+ 993us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:40.028616 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:40.028619 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:40.028801 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:40.029242 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:40.029245 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:40.029247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:40.029527 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:40.029637 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:40.030459 (+ 822us) server_negotiation.cc:299] Negotiation successful
0619 06:39:40.030623 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260619 06:39:40.032052 21826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:40.011620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:36825 (local address 127.10.192.67:41225)
0619 06:39:40.012517 (+ 897us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:40.012587 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:40.014952 (+ 2365us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:40.015795 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:40.015808 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:40.016749 (+ 941us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:39:40.017440 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:40.017478 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.018497 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.018500 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:40.020043 (+ 1543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:40.020056 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.020857 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.020867 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:40.021261 (+ 394us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:40.022042 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:39:40.022077 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:39:40.024448 (+ 2371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:39:40.027773 (+ 3325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:40.027780 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:40.027795 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:40.028471 (+ 676us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:40.028919 (+ 448us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:39:40.028922 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:39:40.028925 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:39:40.029138 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:39:40.029672 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:39:40.029679 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:39:40.030097 (+ 418us) client_negotiation.cc:769] Sending connection context
0619 06:39:40.030379 (+ 282us) client_negotiation.cc:240] Negotiation successful
0619 06:39:40.030877 (+ 498us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":342,"threads_started":1}
I20260619 06:39:40.033456 21824 heartbeater.cc:347] Connected to a master server at 127.10.192.126:36825
I20260619 06:39:40.033772 21824 heartbeater.cc:464] Registering TS with master...
I20260619 06:39:40.034579 21824 heartbeater.cc:511] Master 127.10.192.126:36825 requested a full tablet report, sending...
I20260619 06:39:40.036041 21367 ts_manager.cc:194] Registered new tserver with Master: 076d21b528e34da89048f26e04facdb0 (127.10.192.67:38491)
I20260619 06:39:40.036947 21367 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:41225
I20260619 06:39:40.041010 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 06:39:40.058192 21559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:40.045504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36378 (local address 127.10.192.126:36825)
0619 06:39:40.045706 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:40.045714 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:40.046144 (+ 430us) server_negotiation.cc:407] Connection header received
0619 06:39:40.046351 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:40.046358 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:40.046433 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:40.046548 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:40.048028 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.048765 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.049999 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.050416 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.050568 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:40.052973 (+ 2405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:40.052979 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:40.052984 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:40.053027 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:40.055384 (+ 2357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:40.056153 (+ 769us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:40.056161 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:40.056164 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:40.056304 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:40.056706 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:40.056710 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:40.056714 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:40.057058 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:40.057309 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:40.057636 (+ 327us) server_negotiation.cc:299] Negotiation successful
0619 06:39:40.057848 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260619 06:39:40.062182 21367 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36378:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:39:40.068985 21367 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:39:40.097420 21840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:40.083670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35380 (local address 127.10.192.66:34945)
0619 06:39:40.085005 (+ 1335us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:40.085019 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:40.085061 (+ 42us) server_negotiation.cc:407] Connection header received
0619 06:39:40.085198 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:40.085210 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:40.085572 (+ 362us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:40.085865 (+ 293us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:39:40.087920 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.090234 (+ 2314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.094119 (+ 3885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.095887 (+ 1768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.096049 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:40.096276 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:40.096831 (+ 555us) server_negotiation.cc:299] Negotiation successful
0619 06:39:40.097017 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1067,"thread_start_us":654,"threads_started":1}
I20260619 06:39:40.097440 21836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:40.081560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:34945 (local address 127.0.0.1:35380)
0619 06:39:40.082297 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:40.082343 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:40.082538 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:40.086270 (+ 3732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:40.086280 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:40.086326 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:39:40.087635 (+ 1309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:40.087679 (+ 44us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.090483 (+ 2804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.090492 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:40.093809 (+ 3317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:40.093836 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.096412 (+ 2576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.096418 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:40.096587 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:40.096624 (+ 37us) client_negotiation.cc:769] Sending connection context
0619 06:39:40.096792 (+ 168us) client_negotiation.cc:240] Negotiation successful
0619 06:39:40.097013 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":329,"threads_started":1}
I20260619 06:39:40.102231 21838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:40.082180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:38491 (local address 127.0.0.1:58578)
0619 06:39:40.083907 (+ 1727us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:40.083925 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:40.084041 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:40.094376 (+ 10335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:40.094384 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:40.094417 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:39:40.094848 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:40.094859 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.097181 (+ 2322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.097187 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:40.099384 (+ 2197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:40.099401 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.101444 (+ 2043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.101450 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:40.101602 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:40.101636 (+ 34us) client_negotiation.cc:769] Sending connection context
0619 06:39:40.101741 (+ 105us) client_negotiation.cc:240] Negotiation successful
0619 06:39:40.101885 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1578,"thread_start_us":12007,"threads_started":1}
I20260619 06:39:40.102463 21841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:40.084009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58578 (local address 127.10.192.67:38491)
0619 06:39:40.093651 (+ 9642us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:40.093665 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:40.093706 (+ 41us) server_negotiation.cc:407] Connection header received
0619 06:39:40.093821 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:40.093829 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:40.094145 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:40.095079 (+ 934us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:39:40.095348 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.097028 (+ 1680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.099570 (+ 2542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.101242 (+ 1672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.101385 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:40.101625 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:40.101935 (+ 310us) server_negotiation.cc:299] Negotiation successful
0619 06:39:40.102116 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9437,"thread_start_us":9264,"threads_started":1}
I20260619 06:39:40.101889 21626 tablet_service.cc:1467] Processing CreateTablet for tablet 2c92fdd0b46c4a09bc6141d3df099373 (DEFAULT_TABLE table=test-table [id=5b147e00e59f493cbc5ba747720c9803]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:39:40.103447 21626 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c92fdd0b46c4a09bc6141d3df099373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:40.103804 21837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:40.082720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:35203 (local address 127.0.0.1:35412)
0619 06:39:40.093939 (+ 11219us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:40.093958 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:40.094076 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:40.095543 (+ 1467us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:40.095549 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:40.095579 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:39:40.096030 (+ 451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:40.096043 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.098194 (+ 2151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.098199 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:40.100327 (+ 2128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:40.100343 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.103000 (+ 2657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.103007 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:40.103169 (+ 162us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:40.103201 (+ 32us) client_negotiation.cc:769] Sending connection context
0619 06:39:40.103288 (+ 87us) client_negotiation.cc:240] Negotiation successful
0619 06:39:40.103412 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11089,"mutex_wait_us":3,"thread_start_us":909,"threads_started":1}
I20260619 06:39:40.104203 21839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:40.083236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35412 (local address 127.10.192.65:35203)
0619 06:39:40.094906 (+ 11670us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:40.094917 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:40.094947 (+ 30us) server_negotiation.cc:407] Connection header received
0619 06:39:40.095043 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:40.095050 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:40.095294 (+ 244us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:40.096234 (+ 940us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:39:40.096496 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.098035 (+ 1539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.100538 (+ 2503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.102771 (+ 2233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.102921 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:40.103132 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:40.103371 (+ 239us) server_negotiation.cc:299] Negotiation successful
0619 06:39:40.103693 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11486,"thread_start_us":11328,"threads_started":1}
I20260619 06:39:40.106082 21759 tablet_service.cc:1467] Processing CreateTablet for tablet 2c92fdd0b46c4a09bc6141d3df099373 (DEFAULT_TABLE table=test-table [id=5b147e00e59f493cbc5ba747720c9803]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:39:40.107584 21759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c92fdd0b46c4a09bc6141d3df099373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:40.107852 21492 tablet_service.cc:1467] Processing CreateTablet for tablet 2c92fdd0b46c4a09bc6141d3df099373 (DEFAULT_TABLE table=test-table [id=5b147e00e59f493cbc5ba747720c9803]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:39:40.109282 21492 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2c92fdd0b46c4a09bc6141d3df099373. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:39:40.118412 21842 tablet_bootstrap.cc:492] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634: Bootstrap starting.
I20260619 06:39:40.119268 21843 tablet_bootstrap.cc:492] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0: Bootstrap starting.
I20260619 06:39:40.122160 21842 tablet_bootstrap.cc:654] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:40.122843 21843 tablet_bootstrap.cc:654] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:40.123451 21842 log.cc:824] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634: Log is configured to *not* fsync() on all Append() calls
I20260619 06:39:40.124058 21843 log.cc:824] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0: Log is configured to *not* fsync() on all Append() calls
I20260619 06:39:40.125525 21846 tablet_bootstrap.cc:492] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f: Bootstrap starting.
I20260619 06:39:40.126652 21842 tablet_bootstrap.cc:492] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634: No bootstrap required, opened a new log
I20260619 06:39:40.126916 21842 ts_tablet_manager.cc:1397] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260619 06:39:40.128573 21846 tablet_bootstrap.cc:654] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f: Neither blocks nor log segments found. Creating new log.
I20260619 06:39:40.129787 21846 log.cc:824] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f: Log is configured to *not* fsync() on all Append() calls
I20260619 06:39:40.130189 21843 tablet_bootstrap.cc:492] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0: No bootstrap required, opened a new log
I20260619 06:39:40.130507 21843 ts_tablet_manager.cc:1397] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260619 06:39:40.132916 21846 tablet_bootstrap.cc:492] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f: No bootstrap required, opened a new log
I20260619 06:39:40.133170 21846 ts_tablet_manager.cc:1397] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s
I20260619 06:39:40.136318 21842 raft_consensus.cc:348] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2679633876754202a03126592a3cf634" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34945 } } peers { permanent_uuid: "c769d81762d74918ae30392f5b99a50f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35203 } } peers { permanent_uuid: "076d21b528e34da89048f26e04facdb0" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38491 } }
I20260619 06:39:40.136744 21842 raft_consensus.cc:374] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:40.136838 21842 raft_consensus.cc:729] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2679633876754202a03126592a3cf634, State: Initialized, Role: FOLLOWER
I20260619 06:39:40.137547 21842 consensus_queue.cc:260] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2679633876754202a03126592a3cf634" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34945 } } peers { permanent_uuid: "c769d81762d74918ae30392f5b99a50f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35203 } } peers { permanent_uuid: "076d21b528e34da89048f26e04facdb0" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38491 } }
I20260619 06:39:40.139050 21691 heartbeater.cc:503] Master 127.10.192.126:36825 was elected leader, sending a full tablet report...
I20260619 06:39:40.139400 21842 ts_tablet_manager.cc:1428] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260619 06:39:40.141189 21843 raft_consensus.cc:348] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2679633876754202a03126592a3cf634" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34945 } } peers { permanent_uuid: "c769d81762d74918ae30392f5b99a50f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35203 } } peers { permanent_uuid: "076d21b528e34da89048f26e04facdb0" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38491 } }
I20260619 06:39:40.141645 21843 raft_consensus.cc:374] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:40.141747 21843 raft_consensus.cc:729] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 076d21b528e34da89048f26e04facdb0, State: Initialized, Role: FOLLOWER
I20260619 06:39:40.142398 21843 consensus_queue.cc:260] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2679633876754202a03126592a3cf634" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34945 } } peers { permanent_uuid: "c769d81762d74918ae30392f5b99a50f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35203 } } peers { permanent_uuid: "076d21b528e34da89048f26e04facdb0" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38491 } }
I20260619 06:39:40.143605 21824 heartbeater.cc:503] Master 127.10.192.126:36825 was elected leader, sending a full tablet report...
I20260619 06:39:40.144225 21843 ts_tablet_manager.cc:1428] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260619 06:39:40.143963 21846 raft_consensus.cc:348] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2679633876754202a03126592a3cf634" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34945 } } peers { permanent_uuid: "c769d81762d74918ae30392f5b99a50f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35203 } } peers { permanent_uuid: "076d21b528e34da89048f26e04facdb0" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38491 } }
I20260619 06:39:40.144402 21846 raft_consensus.cc:374] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:39:40.144521 21846 raft_consensus.cc:729] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c769d81762d74918ae30392f5b99a50f, State: Initialized, Role: FOLLOWER
I20260619 06:39:40.145123 21846 consensus_queue.cc:260] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2679633876754202a03126592a3cf634" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34945 } } peers { permanent_uuid: "c769d81762d74918ae30392f5b99a50f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35203 } } peers { permanent_uuid: "076d21b528e34da89048f26e04facdb0" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38491 } }
I20260619 06:39:40.146906 21846 ts_tablet_manager.cc:1428] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260619 06:39:40.225978 21848 raft_consensus.cc:482] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:39:40.226311 21848 raft_consensus.cc:504] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2679633876754202a03126592a3cf634" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34945 } } peers { permanent_uuid: "c769d81762d74918ae30392f5b99a50f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35203 } } peers { permanent_uuid: "076d21b528e34da89048f26e04facdb0" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38491 } }
I20260619 06:39:40.228106 21848 leader_election.cc:288] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c769d81762d74918ae30392f5b99a50f (127.10.192.65:35203), 076d21b528e34da89048f26e04facdb0 (127.10.192.67:38491)
W20260619 06:39:40.231686 21558 tablet.cc:2369] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:39:40.235720 21839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:40.228551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:34405 (local address 127.10.192.65:35203)
0619 06:39:40.228757 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:40.228764 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:40.229727 (+ 963us) server_negotiation.cc:407] Connection header received
0619 06:39:40.229876 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:40.229882 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:40.229975 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:40.230072 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:39:40.230986 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.232076 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.233871 (+ 1795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.234654 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.234854 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:40.234952 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:40.235265 (+ 313us) server_negotiation.cc:299] Negotiation successful
0619 06:39:40.235395 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260619 06:39:40.235858 21852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:40.228691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:35203 (local address 127.10.192.66:34405)
0619 06:39:40.229628 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:40.229642 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:40.229739 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:40.230107 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:40.230112 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:40.230138 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:39:40.230779 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:40.230791 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.232220 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.232227 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:40.233732 (+ 1505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:40.233745 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.234917 (+ 1172us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.234923 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:40.235096 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:40.235121 (+ 25us) client_negotiation.cc:769] Sending connection context
0619 06:39:40.235240 (+ 119us) client_negotiation.cc:240] Negotiation successful
0619 06:39:40.235376 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":821,"mutex_wait_us":43,"thread_start_us":601,"threads_started":1}
I20260619 06:39:40.237289 21512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c92fdd0b46c4a09bc6141d3df099373" candidate_uuid: "2679633876754202a03126592a3cf634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c769d81762d74918ae30392f5b99a50f" is_pre_election: true
I20260619 06:39:40.237942 21512 raft_consensus.cc:2454] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2679633876754202a03126592a3cf634 in term 0.
I20260619 06:39:40.238598 21841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:40.228551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:54197 (local address 127.10.192.67:38491)
0619 06:39:40.228757 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:40.228764 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:40.229625 (+ 861us) server_negotiation.cc:407] Connection header received
0619 06:39:40.229886 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:40.229891 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:40.229965 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:40.230072 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:39:40.230890 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.232076 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.236484 (+ 4408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.237531 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.237678 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:40.237750 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:40.238210 (+ 460us) server_negotiation.cc:299] Negotiation successful
0619 06:39:40.238337 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260619 06:39:40.238750 21851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:40.228678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:38491 (local address 127.10.192.66:54197)
0619 06:39:40.229493 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0619 06:39:40.229514 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 06:39:40.229688 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:39:40.230107 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:39:40.230112 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:39:40.230202 (+ 90us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:39:40.230718 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:40.230735 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.233921 (+ 3186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.233926 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:40.236329 (+ 2403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:39:40.236347 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.237908 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.237913 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:39:40.238049 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:40.238071 (+ 22us) client_negotiation.cc:769] Sending connection context
0619 06:39:40.238183 (+ 112us) client_negotiation.cc:240] Negotiation successful
0619 06:39:40.238317 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":613,"mutex_wait_us":35,"spinlock_wait_cycles":24960,"thread_start_us":318,"threads_started":1}
I20260619 06:39:40.238682 21579 leader_election.cc:302] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2679633876754202a03126592a3cf634, c769d81762d74918ae30392f5b99a50f; no voters:
I20260619 06:39:40.239123 21848 raft_consensus.cc:2781] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:39:40.239279 21848 raft_consensus.cc:482] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:39:40.239382 21848 raft_consensus.cc:3037] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:40.239817 21779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c92fdd0b46c4a09bc6141d3df099373" candidate_uuid: "2679633876754202a03126592a3cf634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "076d21b528e34da89048f26e04facdb0" is_pre_election: true
I20260619 06:39:40.240355 21779 raft_consensus.cc:2454] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2679633876754202a03126592a3cf634 in term 0.
I20260619 06:39:40.242538 21848 raft_consensus.cc:504] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2679633876754202a03126592a3cf634" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34945 } } peers { permanent_uuid: "c769d81762d74918ae30392f5b99a50f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35203 } } peers { permanent_uuid: "076d21b528e34da89048f26e04facdb0" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38491 } }
I20260619 06:39:40.243180 21848 leader_election.cc:288] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [CANDIDATE]: Term 1 election: Requested vote from peers c769d81762d74918ae30392f5b99a50f (127.10.192.65:35203), 076d21b528e34da89048f26e04facdb0 (127.10.192.67:38491)
I20260619 06:39:40.243670 21779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c92fdd0b46c4a09bc6141d3df099373" candidate_uuid: "2679633876754202a03126592a3cf634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "076d21b528e34da89048f26e04facdb0"
I20260619 06:39:40.243713 21512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2c92fdd0b46c4a09bc6141d3df099373" candidate_uuid: "2679633876754202a03126592a3cf634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c769d81762d74918ae30392f5b99a50f"
I20260619 06:39:40.243860 21779 raft_consensus.cc:3037] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:40.243942 21512 raft_consensus.cc:3037] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:39:40.246119 21512 raft_consensus.cc:2454] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2679633876754202a03126592a3cf634 in term 1.
I20260619 06:39:40.246585 21579 leader_election.cc:302] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2679633876754202a03126592a3cf634, c769d81762d74918ae30392f5b99a50f; no voters:
I20260619 06:39:40.246873 21848 raft_consensus.cc:2781] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:39:40.246951 21779 raft_consensus.cc:2454] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2679633876754202a03126592a3cf634 in term 1.
I20260619 06:39:40.248019 21848 raft_consensus.cc:686] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [term 1 LEADER]: Becoming Leader. State: Replica: 2679633876754202a03126592a3cf634, State: Running, Role: LEADER
I20260619 06:39:40.248518 21848 consensus_queue.cc:237] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2679633876754202a03126592a3cf634" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34945 } } peers { permanent_uuid: "c769d81762d74918ae30392f5b99a50f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35203 } } peers { permanent_uuid: "076d21b528e34da89048f26e04facdb0" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38491 } }
W20260619 06:39:40.250635 21692 tablet.cc:2369] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:39:40.253293 21368 catalog_manager.cc:5495] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2679633876754202a03126592a3cf634 (127.10.192.66). New cstate: current_term: 1 leader_uuid: "2679633876754202a03126592a3cf634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2679633876754202a03126592a3cf634" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c769d81762d74918ae30392f5b99a50f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "076d21b528e34da89048f26e04facdb0" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38491 } health_report { overall_health: UNKNOWN } } }
W20260619 06:39:40.260123 21825 tablet.cc:2369] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:39:40.286517 21840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:40.281629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35384 (local address 127.10.192.66:34945)
0619 06:39:40.281877 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:40.281882 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:40.281901 (+ 19us) server_negotiation.cc:407] Connection header received
0619 06:39:40.282009 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:40.282012 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:40.282090 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:40.282215 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:39:40.282553 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.283247 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.284517 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.284902 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.284997 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:40.285428 (+ 431us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:39:40.285922 (+ 494us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:39:40.286036 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:40.286113 (+ 77us) server_negotiation.cc:299] Negotiation successful
0619 06:39:40.286178 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260619 06:39:40.294716 21779 raft_consensus.cc:1261] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0 [term 1 FOLLOWER]: Refusing update from remote peer 2679633876754202a03126592a3cf634: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:39:40.294716 21512 raft_consensus.cc:1261] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f [term 1 FOLLOWER]: Refusing update from remote peer 2679633876754202a03126592a3cf634: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:39:40.295740 21853 consensus_queue.cc:1035] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "076d21b528e34da89048f26e04facdb0" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38491 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:39:40.296100 21848 consensus_queue.cc:1035] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c769d81762d74918ae30392f5b99a50f" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 35203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:39:40.323323 21367 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:39:40.323690 21367 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36378:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:39:40.327785 21367 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b1c53ba839344228b178a447a9aec6fe: Sending DeleteTablet for 3 replicas of tablet 2c92fdd0b46c4a09bc6141d3df099373
I20260619 06:39:40.328981 21626 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c92fdd0b46c4a09bc6141d3df099373 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:40 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:35380
I20260619 06:39:40.329039 21492 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c92fdd0b46c4a09bc6141d3df099373 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:40 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:35412
I20260619 06:39:40.329329 21759 tablet_service.cc:1514] Processing DeleteTablet for tablet 2c92fdd0b46c4a09bc6141d3df099373 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:39:40 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:58578
I20260619 06:39:40.331794 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 21429
I20260619 06:39:40.348186 21868 tablet_replica.cc:330] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0: stopping tablet replica
I20260619 06:39:40.348675 21868 raft_consensus.cc:2229] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:39:40.349201 21868 raft_consensus.cc:2258] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:39:40.351496 21868 ts_tablet_manager.cc:1905] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:39:40.359086 21868 ts_tablet_manager.cc:1918] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:39:40.359251 21866 tablet_replica.cc:330] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f: stopping tablet replica
I20260619 06:39:40.359460 21868 log.cc:1196] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/2c92fdd0b46c4a09bc6141d3df099373
I20260619 06:39:40.359933 21866 raft_consensus.cc:2229] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:39:40.360201 21868 ts_tablet_manager.cc:1939] T 2c92fdd0b46c4a09bc6141d3df099373 P 076d21b528e34da89048f26e04facdb0: Deleting consensus metadata
I20260619 06:39:40.360615 21866 raft_consensus.cc:2258] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:39:40.363463 21353 catalog_manager.cc:4841] TS 076d21b528e34da89048f26e04facdb0 (127.10.192.67:38491): tablet 2c92fdd0b46c4a09bc6141d3df099373 (table test-table [id=5b147e00e59f493cbc5ba747720c9803]) successfully deleted
I20260619 06:39:40.364151 21867 tablet_replica.cc:330] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634: stopping tablet replica
I20260619 06:39:40.364560 21867 raft_consensus.cc:2229] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:39:40.365247 21867 raft_consensus.cc:2258] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:39:40.367869 21866 ts_tablet_manager.cc:1905] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:39:40.368667 21867 ts_tablet_manager.cc:1905] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634: Deleting tablet data with delete state TABLET_DATA_DELETED
Jun 19 06:39:40 dist-test-slave-7lz4 krb5kdc[21323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:39:40.375000 21866 ts_tablet_manager.cc:1918] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:39:40.375167 21866 log.cc:1196] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/2c92fdd0b46c4a09bc6141d3df099373
I20260619 06:39:40.375777 21866 ts_tablet_manager.cc:1939] T 2c92fdd0b46c4a09bc6141d3df099373 P c769d81762d74918ae30392f5b99a50f: Deleting consensus metadata
I20260619 06:39:40.375890 21867 ts_tablet_manager.cc:1918] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:39:40.376075 21867 log.cc:1196] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/2c92fdd0b46c4a09bc6141d3df099373
I20260619 06:39:40.376587 21867 ts_tablet_manager.cc:1939] T 2c92fdd0b46c4a09bc6141d3df099373 P 2679633876754202a03126592a3cf634: Deleting consensus metadata
I20260619 06:39:40.377907 21352 catalog_manager.cc:4841] TS c769d81762d74918ae30392f5b99a50f (127.10.192.65:35203): tablet 2c92fdd0b46c4a09bc6141d3df099373 (table test-table [id=5b147e00e59f493cbc5ba747720c9803]) successfully deleted
I20260619 06:39:40.378224 21352 catalog_manager.cc:4841] TS 2679633876754202a03126592a3cf634 (127.10.192.66:34945): tablet 2c92fdd0b46c4a09bc6141d3df099373 (table test-table [id=5b147e00e59f493cbc5ba747720c9803]) successfully deleted
I20260619 06:39:40.384035 21839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:40.333630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35422 (local address 127.10.192.65:35203)
0619 06:39:40.333861 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:40.333871 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:40.358135 (+ 24264us) server_negotiation.cc:407] Connection header received
0619 06:39:40.361179 (+ 3044us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:40.361188 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:40.361308 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:40.361403 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:40.365658 (+ 4255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.366809 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.368878 (+ 2069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.369595 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.369709 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:40.375380 (+ 5671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:40.375398 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:40.375417 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:40.375466 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:40.380982 (+ 5516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:40.381754 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:40.381763 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:40.381765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:40.381913 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:40.382329 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:40.382333 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:40.382335 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:40.382686 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:40.383017 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:40.383306 (+ 289us) server_negotiation.cc:299] Negotiation successful
0619 06:39:40.383526 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 06:39:40.384758 21552 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:40.475834 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 21429
I20260619 06:39:40.493940 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 21563
Jun 19 06:39:40 dist-test-slave-7lz4 krb5kdc[21323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.66@KRBTEST.COM
I20260619 06:39:40.514056 21840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:40.494775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35394 (local address 127.10.192.66:34945)
0619 06:39:40.494963 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:40.494971 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:40.494993 (+ 22us) server_negotiation.cc:407] Connection header received
0619 06:39:40.495205 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:40.495211 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:40.495320 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:40.495490 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:40.497111 (+ 1621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.498371 (+ 1260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.500266 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.500979 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.501104 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:40.506442 (+ 5338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:40.506458 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:40.506477 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:40.506524 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:40.510677 (+ 4153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:40.511521 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:40.511531 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:40.511535 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:40.511737 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:40.512196 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:40.512207 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:40.512212 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:40.512684 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:40.513162 (+ 478us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:40.513339 (+ 177us) server_negotiation.cc:299] Negotiation successful
0619 06:39:40.513591 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260619 06:39:40.514776 21686 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:40.629119 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 21563
I20260619 06:39:40.647362 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 21696
Jun 19 06:39:40 dist-test-slave-7lz4 krb5kdc[21323](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851177, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.67@KRBTEST.COM
I20260619 06:39:40.662073 21841 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:39:40.648143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58582 (local address 127.10.192.67:38491)
0619 06:39:40.648360 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0619 06:39:40.648367 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:39:40.648387 (+ 20us) server_negotiation.cc:407] Connection header received
0619 06:39:40.648574 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:39:40.648578 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:39:40.648639 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:39:40.648745 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:39:40.649998 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.650725 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.652045 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:39:40.652527 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:39:40.652625 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:39:40.656941 (+ 4316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:39:40.656956 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:39:40.656972 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:39:40.657010 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:39:40.659544 (+ 2534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:40.660223 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:40.660230 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:40.660232 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:40.660391 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:39:40.660703 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:39:40.660706 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:39:40.660708 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:39:40.661022 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:39:40.661235 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0619 06:39:40.661548 (+ 313us) server_negotiation.cc:299] Negotiation successful
0619 06:39:40.661699 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260619 06:39:40.662704 21819 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:40.756655 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 21696
I20260619 06:39:40.772908 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 21336
I20260619 06:39:40.774024 21398 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:39:40.882596 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 21336
2026-06-19T06:39:40Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (4313 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:39:40 dist-test-slave-7lz4 krb5kdc[21876](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:39:40 dist-test-slave-7lz4 krb5kdc[21876](info): set up 2 sockets
Jun 19 06:39:40 dist-test-slave-7lz4 krb5kdc[21876](info): commencing operation
krb5kdc: starting...
W20260619 06:39:42.004601 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.003s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:39:42 dist-test-slave-7lz4 krb5kdc[21876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851182, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:39:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:39:42Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.10.192.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.10.192.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.10.192.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/rangeradmin_127.10.192.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.10.192.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/rangeradmin_127.10.192.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.10.192.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.10.192.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.10.192.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/rangerlookup_127.10.192.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.10.192.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/rangerlookup_127.10.192.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.192.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.10.192.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.192.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/HTTP_127.10.192.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.192.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/HTTP_127.10.192.84@KRBTEST.COM.keytab.
I20260619 06:39:42.343446 11009 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskx_grPe/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/postgres -l logfile start
2026-06-19 06:39:44.998 UTC [21906] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-06-19 06:39:44.998 UTC [21906] LOG: listening on IPv4 address "127.10.192.84", port 44099
2026-06-19 06:39:45.002 UTC [21906] LOG: listening on Unix socket "/tmp/.s.PGSQL.44099"
2026-06-19 06:39:45.026 UTC [21909] LOG: database system was shut down at 2026-06-19 06:39:43 UTC
2026-06-19 06:39:45.029 UTC [21906] LOG: database system is ready to accept connections
I20260619 06:39:46.024168 11009 mini_postgres.cc:96] Postgres bound to 44099
2026-06-19 06:39:46.042 UTC [21917] FATAL: database "slave" does not exist
127.10.192.84:44099 - accepting connections
I20260619 06:39:46.043545 11009 mini_ranger.cc:161] Starting Ranger...
I20260619 06:39:46.071326 11009 mini_ranger.cc:84] Created miniranger Postgres user
I20260619 06:39:46.570305 11009 mini_ranger.cc:87] Created ranger Postgres database
I20260619 06:39:46.570451 11009 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ranger-admin
2026-06-19 06:39:46,882 [I] DB FLAVOR :POSTGRES
2026-06-19 06:39:46,882 [I] --------- Verifying Ranger DB connection ---------
2026-06-19 06:39:46,883 [I] Checking connection..
2026-06-19 06:39:46,883 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-06-19 06:39:47,134 [I] Checking connection passed.
2026-06-19 06:39:47,134 [I] --------- Verifying version history table ---------
2026-06-19 06:39:47,134 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-19 06:39:47,385 [I] Table x_db_version_h does not exist in database ranger
2026-06-19 06:39:47,385 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-19 06:39:47,638 [I] Table x_db_version_h does not exist in database ranger
2026-06-19 06:39:47,638 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-06-19 06:39:47,638 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-06-19 06:39:47.870 UTC [21981] WARNING: there is no transaction in progress
2026-06-19 06:39:47,877 [I] create_dbversion_catalog.sql file imported successfully
2026-06-19 06:39:47,878 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-19 06:39:48,123 [I] Table x_db_version_h already exists in database 'ranger'
2026-06-19 06:39:48,124 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-19 06:39:48,124 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-06-19 06:39:48,390 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-06-19 06:39:48,629 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7lz4.c.gcp-upstream.internal','N') ;"
2026-06-19 06:39:48,889 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-19 06:39:49,162 [I] Table x_portal_user does not exist in database ranger
2026-06-19 06:39:49,163 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-19 06:39:49,400 [I] Table x_policy_ref_group does not exist in database ranger
2026-06-19 06:39:49,400 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-19 06:39:49,648 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-19 06:39:49,885 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-06-19 06:39:49,886 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-06-19 06:39:50.877 UTC [22089] WARNING: there is no transaction in progress
2026-06-19 06:39:50.894 UTC [22089] WARNING: there is no transaction in progress
2026-06-19 06:39:50.910 UTC [22089] WARNING: there is no transaction in progress
2026-06-19 06:39:50.925 UTC [22089] WARNING: there is no transaction in progress
2026-06-19 06:39:50.944 UTC [22089] WARNING: there is no transaction in progress
2026-06-19 06:39:50.961 UTC [22089] WARNING: there is no transaction in progress
2026-06-19 06:39:51.020 UTC [22089] WARNING: there is no transaction in progress
2026-06-19 06:39:51.027 UTC [22089] WARNING: there is no transaction in progress
2026-06-19 06:39:51.043 UTC [22089] WARNING: there is no transaction in progress
2026-06-19 06:39:51.053 UTC [22089] WARNING: there is no transaction in progress
2026-06-19 06:39:51.064 UTC [22089] WARNING: there is no transaction in progress
2026-06-19 06:39:51.079 UTC [22089] WARNING: there is no transaction in progress
2026-06-19 06:39:51.091 UTC [22089] WARNING: there is no transaction in progress
2026-06-19 06:39:51.098 UTC [22089] WARNING: there is no transaction in progress
2026-06-19 06:39:51.105 UTC [22089] WARNING: there is no transaction in progress
2026-06-19 06:39:51.111 UTC [22089] WARNING: there is no transaction in progress
2026-06-19 06:39:51,781 [I] ranger_core_db_postgres.sql file imported successfully
2026-06-19 06:39:51,781 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-06-19 06:39:52,016 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-06-19 06:39:52,016 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-19 06:39:52,287 [I] Table x_portal_user already exists in database 'ranger'
2026-06-19 06:39:52,287 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-19 06:39:52,539 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-06-19 06:39:52,539 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-19 06:39:52,786 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-19 06:39:53,052 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7lz4.c.gcp-upstream.internal';"
2026-06-19 06:39:53,320 [I] CORE_DB_SCHEMA import status has been updated
2026-06-19 06:39:53,320 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-06-19 06:39:53,578 [I] DB_PATCHES have already been applied
I20260619 06:39:53.584487 11009 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ranger-admin:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskx_grPe/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260619 06:39:53.584620 11009 mini_ranger.cc:193] Using host: 127.10.192.84
I20260619 06:39:53.600677 11009 mini_ranger.cc:227] Ranger admin URL: http://127.10.192.84:56121
Jun 19, 2026 6:39:53 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 19, 2026 6:39:53 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 19, 2026 6:39:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ranger-admin/ews/webapp
Jun 19, 2026 6:39:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Jun 19, 2026 6:39:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ranger-admin/ews/webapp] .....
Jun 19, 2026 6:39:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ranger-admin/ews/webapp].
Jun 19, 2026 6:39:54 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260619 06:39:54.755111 11009 mini_ranger.cc:160] Time spent starting Ranger: real 8.712s user 0.004s sys 0.039s
Jun 19, 2026 6:40:15 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Jun 19, 2026 6:40:15 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.XKeyREST
Jun 19, 2026 6:40:15 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Jun 19, 2026 6:40:15 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Jun 19, 2026 6:40:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Jun 19, 2026 6:40:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Jun 19, 2026 6:40:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Jun 19, 2026 6:40:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Jun 19, 2026 6:40:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Jun 19, 2026 6:40:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Jun 19, 2026 6:40:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Jun 19, 2026 6:40:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Jun 19, 2026 6:40:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Jun 19, 2026 6:40:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Jun 19, 2026 6:40:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Jun 19, 2026 6:40:15 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Jun 19, 2026 6:40:15 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Jun 19, 2026 6:40:16 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260619 06:40:17.094730 11009 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.10.192.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.10.192.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.10.192.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/rangerkms_127.10.192.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.10.192.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/rangerkms_127.10.192.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.192.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.10.192.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.192.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/HTTP_127.10.192.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.192.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/HTTP_127.10.192.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Jun 19 06:40:17 dist-test-slave-7lz4 krb5kdc[21876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851217, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260619 06:40:17.267132 11009 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260619 06:40:17.288774 11009 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260619 06:40:18.117954 11009 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260619 06:40:18.118162 11009 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ranger-kms
I20260619 06:40:18.118347 11009 mini_ranger_kms.cc:227] Using postgres at 127.10.192.84:44099
2026-06-19 06:40:18,539 [I] DB FLAVOR :POSTGRES
2026-06-19 06:40:18,539 [I] --------- Verifying Ranger DB connection ---------
2026-06-19 06:40:18,539 [I] Checking connection
2026-06-19 06:40:18,539 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-06-19 06:40:18,777 [I] connection success
2026-06-19 06:40:18,777 [I] --------- Verifying Ranger DB tables ---------
2026-06-19 06:40:18,777 [I] Verifying table ranger_masterkey in database rangerkms
2026-06-19 06:40:18,777 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-06-19 06:40:19,045 [I] Table ranger_masterkey does not exist in database rangerkms
2026-06-19 06:40:19,045 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-19 06:40:19,045 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-06-19 06:40:19,045 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:44099/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-06-19 06:40:19,327 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260619 06:40:19.779163 11009 mini_ranger_kms.cc:310] Created kms service
I20260619 06:40:19.988324 11009 mini_ranger_kms.cc:326] Created kudu user
I20260619 06:40:20.033581 11009 mini_ranger_kms.cc:343] Created rangerkms user
Jun 19 06:40:20 dist-test-slave-7lz4 krb5kdc[21876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851217, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
I20260619 06:40:20.469913 11009 mini_ranger_kms.cc:384] Added ranger policy
I20260619 06:40:20.470227 11009 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ranger-kms:/tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260619 06:40:20.470283 11009 mini_ranger_kms.cc:240] Using host: 127.10.192.84
I20260619 06:40:20.493415 11009 mini_ranger_kms.cc:276] Ranger KMS PID: 22270
I20260619 06:40:20.493577 11009 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.10.192.84:45031
Jun 19, 2026 6:40:21 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 19, 2026 6:40:21 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 19, 2026 6:40:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Jun 19, 2026 6:40:21 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ranger-kms/ews/webapp] .....
Jun 19, 2026 6:40:22 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ranger-kms/ews/webapp].
Jun 19, 2026 6:40:22 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260619 06:40:22.767910 11009 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.501s user 0.082s sys 0.358s
I20260619 06:40:22.768182 11009 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260619 06:40:22.768412 11009 mini_ranger_kms.cc:401] 127.10.192.84:45031/kms/v1/keys
Jun 19 06:40:22 dist-test-slave-7lz4 krb5kdc[21876](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781851222, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.192.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Jun 19 06:40:23 dist-test-slave-7lz4 krb5kdc[21876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851222, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.192.84@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
Jun 19 06:40:23 dist-test-slave-7lz4 krb5kdc[21876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851222, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.192.84@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
Jun 19 06:40:26 dist-test-slave-7lz4 krb5kdc[21876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:40:26.120879 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:43527
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:34417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:43527
--ranger_config_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.192.84:45031/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:40:26.463317 22320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:40:26.463730 22320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:40:26.463898 22320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:40:26.471395 22320 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:40:26.471518 22320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:40:26.471598 22320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:40:26.471698 22320 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:40:26.471784 22320 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:40:26.482306 22320 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:34417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/master-0/wal
--ranger_kms_url=127.10.192.84:45031/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:43527
--ranger_config_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:43527
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:40:26.483752 22320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:40:26.485114 22320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:40:26.498261 22325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:40:26.498200 22328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:40:26.499173 22326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:40:26.499507 22320 server_base.cc:1034] running on GCE node
I20260619 06:40:26.500329 22320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:40:26.502032 22320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:40:26.503255 22320 hybrid_clock.cc:648] HybridClock initialized: now 1781851226503217 us; error 35 us; skew 500 ppm
I20260619 06:40:26.503664 22320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:40:26 dist-test-slave-7lz4 krb5kdc[21876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851226, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:40:26.506907 22320 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:40:26.508658 22320 webserver.cc:460] Webserver started at http://127.10.192.126:37989/ using document root <none> and password file <none>
I20260619 06:40:26.509346 22320 fs_manager.cc:359] Metadata directory not provided
I20260619 06:40:26.509447 22320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:40:26.509796 22320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 06:40:26 dist-test-slave-7lz4 krb5kdc[21876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851226, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
I20260619 06:40:26.578405 22320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "bdb7a58130c44a73b8c68d24ce050cf9"
format_stamp: "Formatted at 2026-06-19 06:40:26 on dist-test-slave-7lz4"
server_key: "ab5f789d73e85c5c11e4361547e2029a"
server_key_iv: "b9b0aa8233940caee9674723a2149433"
server_key_version: "kuduclusterkey@0"
I20260619 06:40:26.579576 22320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "bdb7a58130c44a73b8c68d24ce050cf9"
format_stamp: "Formatted at 2026-06-19 06:40:26 on dist-test-slave-7lz4"
server_key: "ab5f789d73e85c5c11e4361547e2029a"
server_key_iv: "b9b0aa8233940caee9674723a2149433"
server_key_version: "kuduclusterkey@0"
I20260619 06:40:26.587458 22320 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s
I20260619 06:40:26.604825 22335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:40:26.606487 22320 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 06:40:26.606698 22320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "bdb7a58130c44a73b8c68d24ce050cf9"
format_stamp: "Formatted at 2026-06-19 06:40:26 on dist-test-slave-7lz4"
server_key: "ab5f789d73e85c5c11e4361547e2029a"
server_key_iv: "b9b0aa8233940caee9674723a2149433"
server_key_version: "kuduclusterkey@0"
I20260619 06:40:26.606935 22320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:40:26.622601 22320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:40:26.626889 22320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:40:26.627233 22320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:40:26.647084 22320 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:43527
I20260619 06:40:26.647100 22386 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:43527 every 8 connection(s)
I20260619 06:40:26.648741 22320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:40:26.652130 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 22320
I20260619 06:40:26.652338 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:40:26.653152 11009 external_mini_cluster.cc:1428] Setting key 817552b759c276763bce1c3f6dc828b0
I20260619 06:40:26.653447 22387 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:40:26.668380 22387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9: Bootstrap starting.
Jun 19 06:40:26 dist-test-slave-7lz4 krb5kdc[21876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:40:26.672152 22387 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9: Neither blocks nor log segments found. Creating new log.
I20260619 06:40:26.673540 22387 log.cc:824] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9: Log is configured to *not* fsync() on all Append() calls
I20260619 06:40:26.677136 22387 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9: No bootstrap required, opened a new log
I20260619 06:40:26.680486 22390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:26.655586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51574 (local address 127.10.192.126:43527)
0619 06:40:26.656478 (+ 892us) server_negotiation.cc:206] Beginning negotiation
0619 06:40:26.656500 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0619 06:40:26.656552 (+ 52us) server_negotiation.cc:407] Connection header received
0619 06:40:26.658734 (+ 2182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:40:26.658765 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:40:26.659321 (+ 556us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:40:26.659840 (+ 519us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:40:26.661379 (+ 1539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:26.663298 (+ 1919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:26.665126 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:26.666284 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:26.666491 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:26.671490 (+ 4999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:40:26.671501 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:40:26.671521 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:40:26.671567 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:40:26.675569 (+ 4002us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:40:26.676474 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:40:26.676486 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:40:26.676498 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:40:26.676696 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:40:26.677128 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:40:26.677134 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:40:26.677137 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:40:26.677851 (+ 714us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:40:26.678164 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0619 06:40:26.678617 (+ 453us) server_negotiation.cc:299] Negotiation successful
0619 06:40:26.679037 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":438,"threads_started":1}
I20260619 06:40:26.686259 22387 raft_consensus.cc:348] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb7a58130c44a73b8c68d24ce050cf9" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43527 } }
I20260619 06:40:26.686626 22387 raft_consensus.cc:374] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:40:26.686753 22387 raft_consensus.cc:729] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bdb7a58130c44a73b8c68d24ce050cf9, State: Initialized, Role: FOLLOWER
I20260619 06:40:26.687398 22387 consensus_queue.cc:260] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb7a58130c44a73b8c68d24ce050cf9" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43527 } }
I20260619 06:40:26.687639 22387 raft_consensus.cc:388] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:40:26.687801 22387 raft_consensus.cc:482] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:40:26.687971 22387 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:40:26.690486 22387 raft_consensus.cc:504] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb7a58130c44a73b8c68d24ce050cf9" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43527 } }
I20260619 06:40:26.691062 22387 leader_election.cc:302] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bdb7a58130c44a73b8c68d24ce050cf9; no voters:
I20260619 06:40:26.691829 22387 leader_election.cc:288] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:40:26.691965 22392 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:40:26.694424 22387 sys_catalog.cc:564] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:40:26.699061 22392 raft_consensus.cc:686] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9 [term 1 LEADER]: Becoming Leader. State: Replica: bdb7a58130c44a73b8c68d24ce050cf9, State: Running, Role: LEADER
I20260619 06:40:26.700205 22392 consensus_queue.cc:237] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb7a58130c44a73b8c68d24ce050cf9" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43527 } }
I20260619 06:40:26.716061 22393 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bdb7a58130c44a73b8c68d24ce050cf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb7a58130c44a73b8c68d24ce050cf9" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43527 } } }
I20260619 06:40:26.716573 22393 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9 [sys.catalog]: This master's current role is: LEADER
I20260619 06:40:26.717278 22394 sys_catalog.cc:455] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bdb7a58130c44a73b8c68d24ce050cf9. Latest consensus state: current_term: 1 leader_uuid: "bdb7a58130c44a73b8c68d24ce050cf9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bdb7a58130c44a73b8c68d24ce050cf9" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43527 } } }
I20260619 06:40:26.717680 22394 sys_catalog.cc:458] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9 [sys.catalog]: This master's current role is: LEADER
I20260619 06:40:26.720917 22403 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:40:26.726686 22403 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:40:26.727527 22387 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260619 06:40:26.754769 22403 catalog_manager.cc:1347] Generated new cluster ID: e8eadaf4a3c649f9bd5a3d28fb05083e
I20260619 06:40:26.755383 22403 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:40:26.779241 22403 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:40:26.781337 22403 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:40:26.793510 22403 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9: Generated new TSK 0
I20260619 06:40:26.794848 22403 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
I20260619 06:40:27.678311 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.192.84:45031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:43527
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:34417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 06:40:27 dist-test-slave-7lz4 krb5kdc[21876](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781851227, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260619 06:40:28.135424 22433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:40:28.135928 22433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:40:28.136094 22433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:40:28.147979 22433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:40:28.148206 22433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:40:28.148432 22433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:40:28.164602 22433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:34417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.10.192.84:45031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:43527
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:40:28.166344 22433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:40:28.168102 22433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:40:28.185606 22443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:40:28.186563 22444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:40:28.201874 22446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:40:28.202394 22433 server_base.cc:1034] running on GCE node
I20260619 06:40:28.203133 22433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:40:28.204386 22433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:40:28.205662 22433 hybrid_clock.cc:648] HybridClock initialized: now 1781851228205593 us; error 67 us; skew 500 ppm
I20260619 06:40:28.206700 22433 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:40:28 dist-test-slave-7lz4 krb5kdc[21876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851228, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:40:28.211253 22433 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:40:28.225528 22433 webserver.cc:460] Webserver started at http://127.10.192.65:41565/ using document root <none> and password file <none>
I20260619 06:40:28.226733 22433 fs_manager.cc:359] Metadata directory not provided
I20260619 06:40:28.226986 22433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:40:28.227447 22433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 06:40:28 dist-test-slave-7lz4 krb5kdc[21876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851228, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
I20260619 06:40:28.248190 22433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "8c77a81cb4ce4bc789f9b0d05ea7037a"
format_stamp: "Formatted at 2026-06-19 06:40:28 on dist-test-slave-7lz4"
server_key: "1e26d24342062f94f740e3175b98d8e3"
server_key_iv: "1ba9a51be187cd43ec67565b45273b73"
server_key_version: "kuduclusterkey@0"
I20260619 06:40:28.249266 22433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "8c77a81cb4ce4bc789f9b0d05ea7037a"
format_stamp: "Formatted at 2026-06-19 06:40:28 on dist-test-slave-7lz4"
server_key: "1e26d24342062f94f740e3175b98d8e3"
server_key_iv: "1ba9a51be187cd43ec67565b45273b73"
server_key_version: "kuduclusterkey@0"
I20260619 06:40:28.257382 22433 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.005s sys 0.003s
I20260619 06:40:28.279881 22453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:40:28.282084 22433 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.007s sys 0.001s
I20260619 06:40:28.282373 22433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "8c77a81cb4ce4bc789f9b0d05ea7037a"
format_stamp: "Formatted at 2026-06-19 06:40:28 on dist-test-slave-7lz4"
server_key: "1e26d24342062f94f740e3175b98d8e3"
server_key_iv: "1ba9a51be187cd43ec67565b45273b73"
server_key_version: "kuduclusterkey@0"
I20260619 06:40:28.282728 22433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:40:28.355377 22433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:40:28.360883 22433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:40:28.361228 22433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:40:28.362479 22433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:40:28.364373 22433 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:40:28.364532 22433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260619 06:40:28.364676 22433 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:40:28.364743 22433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Jun 19 06:40:28 dist-test-slave-7lz4 krb5kdc[21876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851227, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
I20260619 06:40:28.503604 22433 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:34289
I20260619 06:40:28.503692 22565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:34289 every 8 connection(s)
I20260619 06:40:28.505366 22433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:40:28.510964 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 22433
I20260619 06:40:28.511169 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:40:28.512050 11009 external_mini_cluster.cc:1428] Setting key 340cf869682c05bedd6ac93d71b2f2c9
Jun 19 06:40:28 dist-test-slave-7lz4 krb5kdc[21876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851228, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.192.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.66@KRBTEST.COM" created.
I20260619 06:40:28.583125 22569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:28.526976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:47759 (local address 127.10.192.126:43527)
0619 06:40:28.548007 (+ 21031us) server_negotiation.cc:206] Beginning negotiation
0619 06:40:28.548014 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:40:28.548039 (+ 25us) server_negotiation.cc:407] Connection header received
0619 06:40:28.557483 (+ 9444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:40:28.557491 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:40:28.557636 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:40:28.557726 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:40:28.561060 (+ 3334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:28.562245 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:28.564923 (+ 2678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:28.565650 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:28.565757 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:28.574998 (+ 9241us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:40:28.575006 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:40:28.575013 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:40:28.575065 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:40:28.579217 (+ 4152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:40:28.580265 (+ 1048us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:40:28.580271 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:40:28.580287 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:40:28.580420 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:40:28.580973 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:40:28.580980 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:40:28.580988 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:40:28.581261 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:40:28.581423 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0619 06:40:28.582462 (+ 1039us) server_negotiation.cc:299] Negotiation successful
0619 06:40:28.582713 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20887,"thread_start_us":21046,"threads_started":1}
I20260619 06:40:28.585587 22568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:28.526244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:43527 (local address 127.10.192.65:47759)
0619 06:40:28.546117 (+ 19873us) negotiation.cc:107] Waiting for socket to connect
0619 06:40:28.546201 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0619 06:40:28.557049 (+ 10848us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:40:28.558438 (+ 1389us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:40:28.558453 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:40:28.559209 (+ 756us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:40:28.560154 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:40:28.560181 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:40:28.562479 (+ 2298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:40:28.562484 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:40:28.564727 (+ 2243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:40:28.564743 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:40:28.566133 (+ 1390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:40:28.566139 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:40:28.566439 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:28.571901 (+ 5462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:40:28.571937 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:40:28.574668 (+ 2731us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:40:28.579444 (+ 4776us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:40:28.579456 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:40:28.579478 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:40:28.580106 (+ 628us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:40:28.580571 (+ 465us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:40:28.580578 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:40:28.580584 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:40:28.580835 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:40:28.581400 (+ 565us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:40:28.581409 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:40:28.581959 (+ 550us) client_negotiation.cc:769] Sending connection context
0619 06:40:28.583350 (+ 1391us) client_negotiation.cc:240] Negotiation successful
0619 06:40:28.583989 (+ 639us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19463,"thread_start_us":25271,"threads_started":1}
I20260619 06:40:28.587684 22566 heartbeater.cc:347] Connected to a master server at 127.10.192.126:43527
I20260619 06:40:28.588030 22566 heartbeater.cc:464] Registering TS with master...
I20260619 06:40:28.588953 22566 heartbeater.cc:511] Master 127.10.192.126:43527 requested a full tablet report, sending...
I20260619 06:40:28.591369 22352 ts_manager.cc:194] Registered new tserver with Master: 8c77a81cb4ce4bc789f9b0d05ea7037a (127.10.192.65:34289)
I20260619 06:40:28.592984 22352 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:47759
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
W20260619 06:40:28.618563 11009 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.10.192.66: real 0.103s user 0.000s sys 0.018s
I20260619 06:40:28.619321 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.192.84:45031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:43527
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:34417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 06:40:28 dist-test-slave-7lz4 krb5kdc[21876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851227, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
W20260619 06:40:29.076071 22572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:40:29.076586 22572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:40:29.076794 22572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:40:29.088886 22572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:40:29.089052 22572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:40:29.089300 22572 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:40:29.100733 22572 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:34417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.10.192.84:45031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:43527
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:40:29.102145 22572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:40:29.103492 22572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:40:29.119903 22587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:40:29.119918 22586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:40:29.121747 22589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:40:29.125284 22572 server_base.cc:1034] running on GCE node
I20260619 06:40:29.126037 22572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:40:29.127120 22572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:40:29.128352 22572 hybrid_clock.cc:648] HybridClock initialized: now 1781851229128281 us; error 69 us; skew 500 ppm
I20260619 06:40:29.128681 22572 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:40:29 dist-test-slave-7lz4 krb5kdc[21876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851229, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:40:29.132051 22572 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:40:29.133728 22572 webserver.cc:460] Webserver started at http://127.10.192.66:43115/ using document root <none> and password file <none>
I20260619 06:40:29.134490 22572 fs_manager.cc:359] Metadata directory not provided
I20260619 06:40:29.134662 22572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:40:29.135017 22572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 06:40:29 dist-test-slave-7lz4 krb5kdc[21876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851229, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
I20260619 06:40:29.154059 22572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "2827f88ff41e40c28d53f2b9dd4edf9f"
format_stamp: "Formatted at 2026-06-19 06:40:29 on dist-test-slave-7lz4"
server_key: "b7ce16c90fbdbc6952500cc6cc912706"
server_key_iv: "41f0e5c98ee668c7fd8ef0237af6910f"
server_key_version: "kuduclusterkey@0"
I20260619 06:40:29.155185 22572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "2827f88ff41e40c28d53f2b9dd4edf9f"
format_stamp: "Formatted at 2026-06-19 06:40:29 on dist-test-slave-7lz4"
server_key: "b7ce16c90fbdbc6952500cc6cc912706"
server_key_iv: "41f0e5c98ee668c7fd8ef0237af6910f"
server_key_version: "kuduclusterkey@0"
I20260619 06:40:29.162618 22572 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260619 06:40:29.181859 22596 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:40:29.183966 22572 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260619 06:40:29.184167 22572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "2827f88ff41e40c28d53f2b9dd4edf9f"
format_stamp: "Formatted at 2026-06-19 06:40:29 on dist-test-slave-7lz4"
server_key: "b7ce16c90fbdbc6952500cc6cc912706"
server_key_iv: "41f0e5c98ee668c7fd8ef0237af6910f"
server_key_version: "kuduclusterkey@0"
I20260619 06:40:29.184437 22572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:40:29.216004 22572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:40:29.221073 22572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:40:29.221423 22572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:40:29.222582 22572 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:40:29.224373 22572 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:40:29.224472 22572 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:40:29.224599 22572 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:40:29.224658 22572 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:40:29.261790 22572 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:44785
I20260619 06:40:29.261811 22708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:44785 every 8 connection(s)
I20260619 06:40:29.263486 22572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:40:29.272032 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 22572
I20260619 06:40:29.272249 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:40:29.272775 11009 external_mini_cluster.cc:1428] Setting key 9de43ce325979643787a26ece6bb0d2c
Jun 19 06:40:29 dist-test-slave-7lz4 krb5kdc[21876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851229, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:40:29.290084 22711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:29.267281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:48753 (local address 127.10.192.126:43527)
0619 06:40:29.267830 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0619 06:40:29.267837 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:40:29.268988 (+ 1151us) server_negotiation.cc:407] Connection header received
0619 06:40:29.270918 (+ 1930us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:40:29.270932 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:40:29.271026 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:40:29.271152 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:40:29.273130 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.274341 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.276840 (+ 2499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.277463 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.277594 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:29.282442 (+ 4848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:40:29.282452 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:40:29.282460 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:40:29.282513 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:40:29.286006 (+ 3493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:40:29.287027 (+ 1021us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:40:29.287037 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:40:29.287043 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:40:29.287202 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:40:29.287763 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:40:29.287772 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:40:29.287778 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:40:29.288190 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:40:29.288375 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0619 06:40:29.289309 (+ 934us) server_negotiation.cc:299] Negotiation successful
0619 06:40:29.289646 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":263,"threads_started":1}
I20260619 06:40:29.291353 22712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:29.267992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:43527 (local address 127.10.192.66:48753)
0619 06:40:29.268809 (+ 817us) negotiation.cc:107] Waiting for socket to connect
0619 06:40:29.268856 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 06:40:29.270600 (+ 1744us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:40:29.271347 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:40:29.271355 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:40:29.272009 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:40:29.272893 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:40:29.272922 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.274523 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.274529 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:40:29.276665 (+ 2136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:40:29.276684 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.277729 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.277738 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:40:29.278151 (+ 413us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:29.278990 (+ 839us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:40:29.279036 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:40:29.282115 (+ 3079us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:40:29.286191 (+ 4076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:40:29.286201 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:40:29.286222 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:40:29.286860 (+ 638us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:40:29.287326 (+ 466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:40:29.287331 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:40:29.287335 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:40:29.287610 (+ 275us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:40:29.288368 (+ 758us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:40:29.288377 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:40:29.288829 (+ 452us) client_negotiation.cc:769] Sending connection context
0619 06:40:29.289155 (+ 326us) client_negotiation.cc:240] Negotiation successful
0619 06:40:29.289706 (+ 551us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":427,"threads_started":1}
I20260619 06:40:29.293231 22709 heartbeater.cc:347] Connected to a master server at 127.10.192.126:43527
I20260619 06:40:29.293603 22709 heartbeater.cc:464] Registering TS with master...
I20260619 06:40:29.294541 22709 heartbeater.cc:511] Master 127.10.192.126:43527 requested a full tablet report, sending...
I20260619 06:40:29.296378 22352 ts_manager.cc:194] Registered new tserver with Master: 2827f88ff41e40c28d53f2b9dd4edf9f (127.10.192.66:44785)
I20260619 06:40:29.297492 22352 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:48753
WARNING: no policy specified for kudu/127.10.192.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
I20260619 06:40:29.330472 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.192.84:45031/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:43527
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:34417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:40:29.596841 22566 heartbeater.cc:503] Master 127.10.192.126:43527 was elected leader, sending a full tablet report...
W20260619 06:40:29.663750 22715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:40:29.664057 22715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:40:29.664156 22715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:40:29.671291 22715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:40:29.671404 22715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:40:29.671514 22715 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:40:29.681303 22715 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:34417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.10.192.84:45031/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:43527
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:40:29.682696 22715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:40:29.684028 22715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:40:29.697325 22720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:40:29.697358 22721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:40:29.697325 22723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:40:29.698638 22715 server_base.cc:1034] running on GCE node
I20260619 06:40:29.699421 22715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:40:29.700484 22715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:40:29.701723 22715 hybrid_clock.cc:648] HybridClock initialized: now 1781851229701662 us; error 73 us; skew 500 ppm
I20260619 06:40:29.702068 22715 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:40:29 dist-test-slave-7lz4 krb5kdc[21876](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851229, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:40:29.705436 22715 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:40:29.706810 22715 webserver.cc:460] Webserver started at http://127.10.192.67:33825/ using document root <none> and password file <none>
I20260619 06:40:29.707482 22715 fs_manager.cc:359] Metadata directory not provided
I20260619 06:40:29.707584 22715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:40:29.707922 22715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 06:40:29 dist-test-slave-7lz4 krb5kdc[21876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851229, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
I20260619 06:40:29.726300 22715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "4b010fa525da4d339c04f521d018cc16"
format_stamp: "Formatted at 2026-06-19 06:40:29 on dist-test-slave-7lz4"
server_key: "f8fb606266f4c24ef63e5c9137634c1b"
server_key_iv: "a2f8965edaa9aa02a57de4c289664f57"
server_key_version: "kuduclusterkey@0"
I20260619 06:40:29.727442 22715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "4b010fa525da4d339c04f521d018cc16"
format_stamp: "Formatted at 2026-06-19 06:40:29 on dist-test-slave-7lz4"
server_key: "f8fb606266f4c24ef63e5c9137634c1b"
server_key_iv: "a2f8965edaa9aa02a57de4c289664f57"
server_key_version: "kuduclusterkey@0"
I20260619 06:40:29.733217 22715 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 06:40:29.747489 22730 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:40:29.749194 22715 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 06:40:29.749366 22715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "4b010fa525da4d339c04f521d018cc16"
format_stamp: "Formatted at 2026-06-19 06:40:29 on dist-test-slave-7lz4"
server_key: "f8fb606266f4c24ef63e5c9137634c1b"
server_key_iv: "a2f8965edaa9aa02a57de4c289664f57"
server_key_version: "kuduclusterkey@0"
I20260619 06:40:29.749596 22715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:40:29.776181 22715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:40:29.780019 22715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:40:29.780339 22715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:40:29.781456 22715 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:40:29.782840 22715 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:40:29.782917 22715 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:40:29.783061 22715 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:40:29.783115 22715 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:40:29.815367 22715 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:41743
I20260619 06:40:29.815388 22842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:41743 every 8 connection(s)
I20260619 06:40:29.816759 22715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:40:29.824793 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 22715
I20260619 06:40:29.824990 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:40:29.825461 11009 external_mini_cluster.cc:1428] Setting key d2d14a484cdee864dc1476bb1d496631
Jun 19 06:40:29 dist-test-slave-7lz4 krb5kdc[21876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851229, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:40:29.836298 22845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:29.819384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:32861 (local address 127.10.192.126:43527)
0619 06:40:29.819893 (+ 509us) server_negotiation.cc:206] Beginning negotiation
0619 06:40:29.819898 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:40:29.820793 (+ 895us) server_negotiation.cc:407] Connection header received
0619 06:40:29.822531 (+ 1738us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:40:29.822536 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:40:29.822644 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:40:29.822765 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:40:29.824207 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.825050 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.826805 (+ 1755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.827228 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.827359 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:29.830699 (+ 3340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:40:29.830705 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:40:29.830711 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:40:29.830751 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:40:29.833260 (+ 2509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:40:29.833980 (+ 720us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:40:29.833985 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:40:29.833989 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:40:29.834117 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:40:29.834558 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:40:29.834563 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:40:29.834566 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:40:29.834844 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:40:29.834995 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0619 06:40:29.835705 (+ 710us) server_negotiation.cc:299] Negotiation successful
0619 06:40:29.835946 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":407,"thread_start_us":294,"threads_started":1}
I20260619 06:40:29.837226 22846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:29.819948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:43527 (local address 127.10.192.67:32861)
0619 06:40:29.820635 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0619 06:40:29.820671 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0619 06:40:29.822257 (+ 1586us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:40:29.822997 (+ 740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:40:29.823006 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:40:29.823440 (+ 434us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:40:29.824033 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:40:29.824054 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.825212 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.825219 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:40:29.826646 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:40:29.826662 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.827446 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.827453 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:40:29.827755 (+ 302us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:29.828473 (+ 718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:40:29.828496 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:40:29.830480 (+ 1984us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:40:29.833409 (+ 2929us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:40:29.833418 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:40:29.833435 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:40:29.833857 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:40:29.834228 (+ 371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:40:29.834233 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:40:29.834237 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:40:29.834442 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:40:29.834969 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:40:29.834977 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:40:29.835331 (+ 354us) client_negotiation.cc:769] Sending connection context
0619 06:40:29.835590 (+ 259us) client_negotiation.cc:240] Negotiation successful
0619 06:40:29.836112 (+ 522us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":281,"threads_started":1}
I20260619 06:40:29.838718 22843 heartbeater.cc:347] Connected to a master server at 127.10.192.126:43527
I20260619 06:40:29.839023 22843 heartbeater.cc:464] Registering TS with master...
I20260619 06:40:29.839852 22843 heartbeater.cc:511] Master 127.10.192.126:43527 requested a full tablet report, sending...
I20260619 06:40:29.841334 22352 ts_manager.cc:194] Registered new tserver with Master: 4b010fa525da4d339c04f521d018cc16 (127.10.192.67:41743)
I20260619 06:40:29.842134 22352 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:32861
I20260619 06:40:29.853520 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 06:40:29.870154 22845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:29.858262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51588 (local address 127.10.192.126:43527)
0619 06:40:29.858450 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0619 06:40:29.858454 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:40:29.858881 (+ 427us) server_negotiation.cc:407] Connection header received
0619 06:40:29.859022 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:40:29.859025 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:40:29.859101 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:40:29.859188 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:40:29.860630 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.861335 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.862652 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.863040 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.863128 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:29.865608 (+ 2480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:40:29.865613 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:40:29.865617 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:40:29.865648 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:40:29.867988 (+ 2340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:40:29.868631 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:40:29.868634 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:40:29.868636 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:40:29.868748 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:40:29.869077 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:40:29.869080 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:40:29.869082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:40:29.869333 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:40:29.869522 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0619 06:40:29.869776 (+ 254us) server_negotiation.cc:299] Negotiation successful
0619 06:40:29.869937 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 06:40:29.874339 22352 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51588:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:40:29.881547 22352 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:40:29.925246 22860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:29.894353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:41743 (local address 127.0.0.1:53868)
0619 06:40:29.908510 (+ 14157us) negotiation.cc:107] Waiting for socket to connect
0619 06:40:29.908564 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 06:40:29.908776 (+ 212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:40:29.917964 (+ 9188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:40:29.917969 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:40:29.918009 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:40:29.918422 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:40:29.918430 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.919743 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.919750 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:40:29.922617 (+ 2867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:40:29.922631 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.924159 (+ 1528us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.924163 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:40:29.924329 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:29.924399 (+ 70us) client_negotiation.cc:769] Sending connection context
0619 06:40:29.924518 (+ 119us) client_negotiation.cc:240] Negotiation successful
0619 06:40:29.924724 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11683,"mutex_wait_us":220,"thread_start_us":15441,"threads_started":1}
I20260619 06:40:29.925347 22861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:29.895698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38076 (local address 127.10.192.65:34289)
0619 06:40:29.915167 (+ 19469us) server_negotiation.cc:206] Beginning negotiation
0619 06:40:29.915182 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0619 06:40:29.916413 (+ 1231us) server_negotiation.cc:407] Connection header received
0619 06:40:29.916613 (+ 200us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:40:29.916626 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:40:29.917005 (+ 379us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:40:29.917243 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:40:29.918245 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.919898 (+ 1653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.922796 (+ 2898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.924217 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.924352 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:29.924618 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0619 06:40:29.924805 (+ 187us) server_negotiation.cc:299] Negotiation successful
0619 06:40:29.924989 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19195,"thread_start_us":19482,"threads_started":1}
I20260619 06:40:29.925269 22857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:29.895286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34289 (local address 127.0.0.1:38076)
0619 06:40:29.916216 (+ 20930us) negotiation.cc:107] Waiting for socket to connect
0619 06:40:29.916241 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0619 06:40:29.916414 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:40:29.917408 (+ 994us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:40:29.917416 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:40:29.917454 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:40:29.917953 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:40:29.917967 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.920035 (+ 2068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.920046 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:40:29.922620 (+ 2574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:40:29.922631 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.924428 (+ 1797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.924434 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:40:29.924609 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:29.924638 (+ 29us) client_negotiation.cc:769] Sending connection context
0619 06:40:29.924718 (+ 80us) client_negotiation.cc:240] Negotiation successful
0619 06:40:29.924825 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20762,"mutex_wait_us":182,"thread_start_us":10996,"threads_started":1}
I20260619 06:40:29.925779 22856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:29.894431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:44785 (local address 127.0.0.1:49106)
0619 06:40:29.910088 (+ 15657us) negotiation.cc:107] Waiting for socket to connect
0619 06:40:29.910119 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0619 06:40:29.910283 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:40:29.917593 (+ 7310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:40:29.917597 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:40:29.917638 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:40:29.918077 (+ 439us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:40:29.918089 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.920721 (+ 2632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.920727 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:40:29.922295 (+ 1568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:40:29.922308 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.924901 (+ 2593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.924908 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:40:29.925078 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:29.925121 (+ 43us) client_negotiation.cc:769] Sending connection context
0619 06:40:29.925195 (+ 74us) client_negotiation.cc:240] Negotiation successful
0619 06:40:29.925324 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15502,"mutex_wait_us":1,"spinlock_wait_cycles":1280,"thread_start_us":21427,"threads_started":1}
I20260619 06:40:29.926606 22859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:29.894897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53868 (local address 127.10.192.67:41743)
0619 06:40:29.917370 (+ 22473us) server_negotiation.cc:206] Beginning negotiation
0619 06:40:29.917378 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:40:29.917424 (+ 46us) server_negotiation.cc:407] Connection header received
0619 06:40:29.917535 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:40:29.917543 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:40:29.917745 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:40:29.917967 (+ 222us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:40:29.918601 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.919575 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.922801 (+ 3226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.923938 (+ 1137us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.925962 (+ 2024us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:29.926145 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0619 06:40:29.926194 (+ 49us) server_negotiation.cc:299] Negotiation successful
0619 06:40:29.926302 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22312,"thread_start_us":22170,"threads_started":1}
I20260619 06:40:29.926760 22858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:29.894766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49106 (local address 127.10.192.66:44785)
0619 06:40:29.916937 (+ 22171us) server_negotiation.cc:206] Beginning negotiation
0619 06:40:29.916947 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:40:29.916982 (+ 35us) server_negotiation.cc:407] Connection header received
0619 06:40:29.917087 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:40:29.917095 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:40:29.917376 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:40:29.917591 (+ 215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:40:29.918262 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.920580 (+ 2318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.922462 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:29.923922 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:29.926019 (+ 2097us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:29.926222 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0619 06:40:29.926291 (+ 69us) server_negotiation.cc:299] Negotiation successful
0619 06:40:29.926461 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22009,"thread_start_us":21909,"threads_started":1}
I20260619 06:40:29.930091 22501 tablet_service.cc:1467] Processing CreateTablet for tablet 12b2548348684ccd9c7938bc77c1c8c0 (DEFAULT_TABLE table=test-table [id=4edff5f2269f48c4bb6ef2ef4662b232]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:40:29.930085 22778 tablet_service.cc:1467] Processing CreateTablet for tablet 12b2548348684ccd9c7938bc77c1c8c0 (DEFAULT_TABLE table=test-table [id=4edff5f2269f48c4bb6ef2ef4662b232]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:40:29.931480 22778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12b2548348684ccd9c7938bc77c1c8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:40:29.931609 22501 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12b2548348684ccd9c7938bc77c1c8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:40:29.932688 22644 tablet_service.cc:1467] Processing CreateTablet for tablet 12b2548348684ccd9c7938bc77c1c8c0 (DEFAULT_TABLE table=test-table [id=4edff5f2269f48c4bb6ef2ef4662b232]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:40:29.934044 22644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12b2548348684ccd9c7938bc77c1c8c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:40:29.943128 22862 tablet_bootstrap.cc:492] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16: Bootstrap starting.
I20260619 06:40:29.946514 22863 tablet_bootstrap.cc:492] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a: Bootstrap starting.
I20260619 06:40:29.948223 22862 tablet_bootstrap.cc:654] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16: Neither blocks nor log segments found. Creating new log.
I20260619 06:40:29.948431 22864 tablet_bootstrap.cc:492] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f: Bootstrap starting.
I20260619 06:40:29.949838 22862 log.cc:824] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16: Log is configured to *not* fsync() on all Append() calls
I20260619 06:40:29.950701 22863 tablet_bootstrap.cc:654] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a: Neither blocks nor log segments found. Creating new log.
I20260619 06:40:29.951747 22864 tablet_bootstrap.cc:654] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f: Neither blocks nor log segments found. Creating new log.
I20260619 06:40:29.952033 22863 log.cc:824] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a: Log is configured to *not* fsync() on all Append() calls
I20260619 06:40:29.952860 22864 log.cc:824] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f: Log is configured to *not* fsync() on all Append() calls
I20260619 06:40:29.953748 22862 tablet_bootstrap.cc:492] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16: No bootstrap required, opened a new log
I20260619 06:40:29.954077 22862 ts_tablet_manager.cc:1397] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260619 06:40:29.955313 22863 tablet_bootstrap.cc:492] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a: No bootstrap required, opened a new log
I20260619 06:40:29.955601 22863 ts_tablet_manager.cc:1397] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260619 06:40:29.956144 22864 tablet_bootstrap.cc:492] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f: No bootstrap required, opened a new log
I20260619 06:40:29.956532 22864 ts_tablet_manager.cc:1397] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260619 06:40:29.962639 22862 raft_consensus.cc:348] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b010fa525da4d339c04f521d018cc16" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41743 } } peers { permanent_uuid: "2827f88ff41e40c28d53f2b9dd4edf9f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 44785 } } peers { permanent_uuid: "8c77a81cb4ce4bc789f9b0d05ea7037a" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34289 } }
I20260619 06:40:29.963083 22862 raft_consensus.cc:374] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:40:29.963210 22862 raft_consensus.cc:729] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b010fa525da4d339c04f521d018cc16, State: Initialized, Role: FOLLOWER
I20260619 06:40:29.963945 22862 consensus_queue.cc:260] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b010fa525da4d339c04f521d018cc16" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41743 } } peers { permanent_uuid: "2827f88ff41e40c28d53f2b9dd4edf9f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 44785 } } peers { permanent_uuid: "8c77a81cb4ce4bc789f9b0d05ea7037a" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34289 } }
I20260619 06:40:29.965145 22843 heartbeater.cc:503] Master 127.10.192.126:43527 was elected leader, sending a full tablet report...
I20260619 06:40:29.965950 22862 ts_tablet_manager.cc:1428] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
I20260619 06:40:29.966670 22863 raft_consensus.cc:348] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b010fa525da4d339c04f521d018cc16" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41743 } } peers { permanent_uuid: "2827f88ff41e40c28d53f2b9dd4edf9f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 44785 } } peers { permanent_uuid: "8c77a81cb4ce4bc789f9b0d05ea7037a" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34289 } }
I20260619 06:40:29.967186 22863 raft_consensus.cc:374] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:40:29.967303 22863 raft_consensus.cc:729] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c77a81cb4ce4bc789f9b0d05ea7037a, State: Initialized, Role: FOLLOWER
I20260619 06:40:29.967083 22864 raft_consensus.cc:348] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b010fa525da4d339c04f521d018cc16" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41743 } } peers { permanent_uuid: "2827f88ff41e40c28d53f2b9dd4edf9f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 44785 } } peers { permanent_uuid: "8c77a81cb4ce4bc789f9b0d05ea7037a" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34289 } }
I20260619 06:40:29.967533 22864 raft_consensus.cc:374] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:40:29.967705 22864 raft_consensus.cc:729] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2827f88ff41e40c28d53f2b9dd4edf9f, State: Initialized, Role: FOLLOWER
I20260619 06:40:29.968000 22863 consensus_queue.cc:260] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b010fa525da4d339c04f521d018cc16" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41743 } } peers { permanent_uuid: "2827f88ff41e40c28d53f2b9dd4edf9f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 44785 } } peers { permanent_uuid: "8c77a81cb4ce4bc789f9b0d05ea7037a" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34289 } }
I20260619 06:40:29.968463 22864 consensus_queue.cc:260] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b010fa525da4d339c04f521d018cc16" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41743 } } peers { permanent_uuid: "2827f88ff41e40c28d53f2b9dd4edf9f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 44785 } } peers { permanent_uuid: "8c77a81cb4ce4bc789f9b0d05ea7037a" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34289 } }
I20260619 06:40:29.970163 22863 ts_tablet_manager.cc:1428] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260619 06:40:29.971333 22709 heartbeater.cc:503] Master 127.10.192.126:43527 was elected leader, sending a full tablet report...
I20260619 06:40:29.973940 22864 ts_tablet_manager.cc:1428] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f: Time spent starting tablet: real 0.017s user 0.014s sys 0.000s
W20260619 06:40:30.018038 22710 tablet.cc:2369] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:40:30.044893 22870 raft_consensus.cc:482] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:40:30.045218 22870 raft_consensus.cc:504] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b010fa525da4d339c04f521d018cc16" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41743 } } peers { permanent_uuid: "2827f88ff41e40c28d53f2b9dd4edf9f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 44785 } } peers { permanent_uuid: "8c77a81cb4ce4bc789f9b0d05ea7037a" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34289 } }
I20260619 06:40:30.047019 22870 leader_election.cc:288] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4b010fa525da4d339c04f521d018cc16 (127.10.192.67:41743), 8c77a81cb4ce4bc789f9b0d05ea7037a (127.10.192.65:34289)
I20260619 06:40:30.054221 22859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:30.047386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:37909 (local address 127.10.192.67:41743)
0619 06:40:30.047614 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0619 06:40:30.047622 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:40:30.048504 (+ 882us) server_negotiation.cc:407] Connection header received
0619 06:40:30.048735 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:40:30.048745 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:40:30.048805 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:40:30.048903 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:40:30.049493 (+ 590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:30.050201 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:30.052043 (+ 1842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:30.052991 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:30.053179 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:30.053333 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0619 06:40:30.053720 (+ 387us) server_negotiation.cc:299] Negotiation successful
0619 06:40:30.053862 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260619 06:40:30.054299 22871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:30.047469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:41743 (local address 127.10.192.66:37909)
0619 06:40:30.048355 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0619 06:40:30.048380 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0619 06:40:30.048587 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:40:30.048926 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:40:30.048931 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:40:30.048955 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:40:30.049343 (+ 388us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:40:30.049352 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:40:30.050338 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:40:30.050344 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:40:30.051888 (+ 1544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:40:30.051901 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:40:30.053333 (+ 1432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:40:30.053342 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:40:30.053478 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:30.053549 (+ 71us) client_negotiation.cc:769] Sending connection context
0619 06:40:30.053663 (+ 114us) client_negotiation.cc:240] Negotiation successful
0619 06:40:30.053820 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":745,"thread_start_us":758,"threads_started":1}
I20260619 06:40:30.054672 22861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:30.047591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:56593 (local address 127.10.192.65:34289)
0619 06:40:30.047791 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0619 06:40:30.047795 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:40:30.048680 (+ 885us) server_negotiation.cc:407] Connection header received
0619 06:40:30.048900 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:40:30.048906 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:40:30.048996 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:40:30.049117 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:40:30.049799 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:30.050533 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:30.052516 (+ 1983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:30.053519 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:30.053757 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:30.053837 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0619 06:40:30.054204 (+ 367us) server_negotiation.cc:299] Negotiation successful
0619 06:40:30.054364 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 06:40:30.054992 22872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:30.047502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34289 (local address 127.10.192.66:56593)
0619 06:40:30.048532 (+ 1030us) negotiation.cc:107] Waiting for socket to connect
0619 06:40:30.048548 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:40:30.048748 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:40:30.049136 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:40:30.049140 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:40:30.049165 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:40:30.049613 (+ 448us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:40:30.049623 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:40:30.050686 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:40:30.050691 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:40:30.052346 (+ 1655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:40:30.052359 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:40:30.053770 (+ 1411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:40:30.053776 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:40:30.053951 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:30.054000 (+ 49us) client_negotiation.cc:769] Sending connection context
0619 06:40:30.054140 (+ 140us) client_negotiation.cc:240] Negotiation successful
0619 06:40:30.054261 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":924,"mutex_wait_us":1,"thread_start_us":460,"threads_started":1}
I20260619 06:40:30.055732 22798 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12b2548348684ccd9c7938bc77c1c8c0" candidate_uuid: "2827f88ff41e40c28d53f2b9dd4edf9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b010fa525da4d339c04f521d018cc16" is_pre_election: true
I20260619 06:40:30.056031 22521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12b2548348684ccd9c7938bc77c1c8c0" candidate_uuid: "2827f88ff41e40c28d53f2b9dd4edf9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c77a81cb4ce4bc789f9b0d05ea7037a" is_pre_election: true
I20260619 06:40:30.056314 22798 raft_consensus.cc:2454] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2827f88ff41e40c28d53f2b9dd4edf9f in term 0.
I20260619 06:40:30.056622 22521 raft_consensus.cc:2454] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2827f88ff41e40c28d53f2b9dd4edf9f in term 0.
I20260619 06:40:30.057111 22599 leader_election.cc:302] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2827f88ff41e40c28d53f2b9dd4edf9f, 4b010fa525da4d339c04f521d018cc16; no voters:
I20260619 06:40:30.057636 22870 raft_consensus.cc:2781] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:40:30.057822 22870 raft_consensus.cc:482] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:40:30.057960 22870 raft_consensus.cc:3037] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:40:30.060335 22870 raft_consensus.cc:504] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b010fa525da4d339c04f521d018cc16" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41743 } } peers { permanent_uuid: "2827f88ff41e40c28d53f2b9dd4edf9f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 44785 } } peers { permanent_uuid: "8c77a81cb4ce4bc789f9b0d05ea7037a" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34289 } }
I20260619 06:40:30.061013 22870 leader_election.cc:288] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [CANDIDATE]: Term 1 election: Requested vote from peers 4b010fa525da4d339c04f521d018cc16 (127.10.192.67:41743), 8c77a81cb4ce4bc789f9b0d05ea7037a (127.10.192.65:34289)
I20260619 06:40:30.061439 22798 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12b2548348684ccd9c7938bc77c1c8c0" candidate_uuid: "2827f88ff41e40c28d53f2b9dd4edf9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4b010fa525da4d339c04f521d018cc16"
I20260619 06:40:30.061517 22521 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12b2548348684ccd9c7938bc77c1c8c0" candidate_uuid: "2827f88ff41e40c28d53f2b9dd4edf9f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8c77a81cb4ce4bc789f9b0d05ea7037a"
I20260619 06:40:30.061663 22798 raft_consensus.cc:3037] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:40:30.061756 22521 raft_consensus.cc:3037] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a [term 0 FOLLOWER]: Advancing to term 1
W20260619 06:40:30.062212 22567 tablet.cc:2369] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:40:30.064606 22521 raft_consensus.cc:2454] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2827f88ff41e40c28d53f2b9dd4edf9f in term 1.
I20260619 06:40:30.064993 22798 raft_consensus.cc:2454] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2827f88ff41e40c28d53f2b9dd4edf9f in term 1.
I20260619 06:40:30.065100 22597 leader_election.cc:302] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2827f88ff41e40c28d53f2b9dd4edf9f, 8c77a81cb4ce4bc789f9b0d05ea7037a; no voters:
I20260619 06:40:30.065445 22870 raft_consensus.cc:2781] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:40:30.065915 22870 raft_consensus.cc:686] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [term 1 LEADER]: Becoming Leader. State: Replica: 2827f88ff41e40c28d53f2b9dd4edf9f, State: Running, Role: LEADER
I20260619 06:40:30.066375 22870 consensus_queue.cc:237] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b010fa525da4d339c04f521d018cc16" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41743 } } peers { permanent_uuid: "2827f88ff41e40c28d53f2b9dd4edf9f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 44785 } } peers { permanent_uuid: "8c77a81cb4ce4bc789f9b0d05ea7037a" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34289 } }
W20260619 06:40:30.068385 22844 tablet.cc:2369] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:40:30.071873 22352 catalog_manager.cc:5495] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f reported cstate change: term changed from 0 to 1, leader changed from <none> to 2827f88ff41e40c28d53f2b9dd4edf9f (127.10.192.66). New cstate: current_term: 1 leader_uuid: "2827f88ff41e40c28d53f2b9dd4edf9f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4b010fa525da4d339c04f521d018cc16" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2827f88ff41e40c28d53f2b9dd4edf9f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 44785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8c77a81cb4ce4bc789f9b0d05ea7037a" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34289 } health_report { overall_health: UNKNOWN } } }
I20260619 06:40:30.112830 22858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:30.107588 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49112 (local address 127.10.192.66:44785)
0619 06:40:30.107826 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0619 06:40:30.107830 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:40:30.107848 (+ 18us) server_negotiation.cc:407] Connection header received
0619 06:40:30.107940 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:40:30.107944 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:40:30.108019 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:40:30.108145 (+ 126us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:40:30.108487 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:30.109192 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:30.110626 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:30.111013 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:30.111178 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:30.111615 (+ 437us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:40:30.112289 (+ 674us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:40:30.112437 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0619 06:40:30.112526 (+ 89us) server_negotiation.cc:299] Negotiation successful
0619 06:40:30.112591 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110}
I20260619 06:40:30.121138 22521 raft_consensus.cc:1261] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a [term 1 FOLLOWER]: Refusing update from remote peer 2827f88ff41e40c28d53f2b9dd4edf9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:40:30.121140 22798 raft_consensus.cc:1261] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16 [term 1 FOLLOWER]: Refusing update from remote peer 2827f88ff41e40c28d53f2b9dd4edf9f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:40:30.122224 22873 consensus_queue.cc:1035] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "4b010fa525da4d339c04f521d018cc16" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 41743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:40:30.122550 22870 consensus_queue.cc:1035] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [LEADER]: Connected to new peer: Peer: permanent_uuid: "8c77a81cb4ce4bc789f9b0d05ea7037a" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:40:30.149129 22352 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51588:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:40:30.149422 22352 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51588:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:40:30.152856 22352 catalog_manager.cc:5782] T 00000000000000000000000000000000 P bdb7a58130c44a73b8c68d24ce050cf9: Sending DeleteTablet for 3 replicas of tablet 12b2548348684ccd9c7938bc77c1c8c0
I20260619 06:40:30.153999 22644 tablet_service.cc:1514] Processing DeleteTablet for tablet 12b2548348684ccd9c7938bc77c1c8c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:40:30 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:49106
I20260619 06:40:30.153995 22778 tablet_service.cc:1514] Processing DeleteTablet for tablet 12b2548348684ccd9c7938bc77c1c8c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:40:30 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:53868
I20260619 06:40:30.155303 22501 tablet_service.cc:1514] Processing DeleteTablet for tablet 12b2548348684ccd9c7938bc77c1c8c0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:40:30 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:38076
I20260619 06:40:30.157821 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 22433
I20260619 06:40:30.161728 22886 tablet_replica.cc:330] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16: stopping tablet replica
I20260619 06:40:30.162212 22886 raft_consensus.cc:2229] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:40:30.163934 22886 raft_consensus.cc:2258] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:40:30.164937 22887 tablet_replica.cc:330] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f: stopping tablet replica
I20260619 06:40:30.165897 22888 tablet_replica.cc:330] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a: stopping tablet replica
I20260619 06:40:30.166388 22888 raft_consensus.cc:2229] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:40:30.166991 22888 raft_consensus.cc:2258] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:40:30.167270 22887 raft_consensus.cc:2229] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:40:30.168546 22887 raft_consensus.cc:2258] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:40:30.169699 22886 ts_tablet_manager.cc:1905] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:40:30.169847 22888 ts_tablet_manager.cc:1905] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:40:30.171906 22887 ts_tablet_manager.cc:1905] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:40:30.177096 22886 ts_tablet_manager.cc:1918] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:40:30.177173 22888 ts_tablet_manager.cc:1918] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:40:30.177346 22886 log.cc:1196] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/12b2548348684ccd9c7938bc77c1c8c0
I20260619 06:40:30.177417 22888 log.cc:1196] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/12b2548348684ccd9c7938bc77c1c8c0
I20260619 06:40:30.177963 22888 ts_tablet_manager.cc:1939] T 12b2548348684ccd9c7938bc77c1c8c0 P 8c77a81cb4ce4bc789f9b0d05ea7037a: Deleting consensus metadata
I20260619 06:40:30.178040 22886 ts_tablet_manager.cc:1939] T 12b2548348684ccd9c7938bc77c1c8c0 P 4b010fa525da4d339c04f521d018cc16: Deleting consensus metadata
I20260619 06:40:30.180042 22338 catalog_manager.cc:4841] TS 4b010fa525da4d339c04f521d018cc16 (127.10.192.67:41743): tablet 12b2548348684ccd9c7938bc77c1c8c0 (table test-table [id=4edff5f2269f48c4bb6ef2ef4662b232]) successfully deleted
I20260619 06:40:30.180565 22336 catalog_manager.cc:4841] TS 8c77a81cb4ce4bc789f9b0d05ea7037a (127.10.192.65:34289): tablet 12b2548348684ccd9c7938bc77c1c8c0 (table test-table [id=4edff5f2269f48c4bb6ef2ef4662b232]) successfully deleted
Jun 19 06:40:30 dist-test-slave-7lz4 krb5kdc[21876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:40:30.183593 22887 ts_tablet_manager.cc:1918] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:40:30.183815 22887 log.cc:1196] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/12b2548348684ccd9c7938bc77c1c8c0
I20260619 06:40:30.184417 22887 ts_tablet_manager.cc:1939] T 12b2548348684ccd9c7938bc77c1c8c0 P 2827f88ff41e40c28d53f2b9dd4edf9f: Deleting consensus metadata
I20260619 06:40:30.186404 22337 catalog_manager.cc:4841] TS 2827f88ff41e40c28d53f2b9dd4edf9f (127.10.192.66:44785): tablet 12b2548348684ccd9c7938bc77c1c8c0 (table test-table [id=4edff5f2269f48c4bb6ef2ef4662b232]) successfully deleted
I20260619 06:40:30.190670 22861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:30.158776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38084 (local address 127.10.192.65:34289)
0619 06:40:30.158953 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0619 06:40:30.158959 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:40:30.165233 (+ 6274us) server_negotiation.cc:407] Connection header received
0619 06:40:30.165479 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:40:30.165487 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:40:30.165590 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:40:30.165718 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:40:30.167683 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:30.168425 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:30.172353 (+ 3928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:30.173043 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:30.173140 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:30.183040 (+ 9900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:40:30.183057 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:40:30.183076 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:40:30.183139 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:40:30.187115 (+ 3976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:40:30.188172 (+ 1057us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:40:30.188181 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:40:30.188183 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:40:30.188356 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:40:30.188836 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:40:30.188847 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:40:30.188850 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:40:30.189308 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:40:30.189654 (+ 346us) server_negotiation.cc:1035] Waiting for connection context
0619 06:40:30.189954 (+ 300us) server_negotiation.cc:299] Negotiation successful
0619 06:40:30.190270 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260619 06:40:30.191414 22561 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:40:30.282614 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 22433
I20260619 06:40:30.301690 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 22572
Jun 19 06:40:30 dist-test-slave-7lz4 krb5kdc[21876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.66@KRBTEST.COM
I20260619 06:40:30.320050 22858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:30.302568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49126 (local address 127.10.192.66:44785)
0619 06:40:30.302736 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0619 06:40:30.302741 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:40:30.302808 (+ 67us) server_negotiation.cc:407] Connection header received
0619 06:40:30.302980 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:40:30.302984 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:40:30.303050 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:40:30.303132 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:40:30.304854 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:30.305689 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:30.307584 (+ 1895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:30.308056 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:30.308155 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:30.313564 (+ 5409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:40:30.313582 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:40:30.313611 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:40:30.313649 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:40:30.317083 (+ 3434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:40:30.317922 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:40:30.317929 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:40:30.317931 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:40:30.318081 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:40:30.318510 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:40:30.318514 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:40:30.318516 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:40:30.318867 (+ 351us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:40:30.319110 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0619 06:40:30.319479 (+ 369us) server_negotiation.cc:299] Negotiation successful
0619 06:40:30.319708 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260619 06:40:30.320834 22704 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:40:30.436636 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 22572
I20260619 06:40:30.454349 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 22715
Jun 19 06:40:30 dist-test-slave-7lz4 krb5kdc[21876](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851226, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.67@KRBTEST.COM
I20260619 06:40:30.469924 22859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:40:30.455169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53884 (local address 127.10.192.67:41743)
0619 06:40:30.455351 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0619 06:40:30.455357 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:40:30.455468 (+ 111us) server_negotiation.cc:407] Connection header received
0619 06:40:30.455706 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:40:30.455711 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:40:30.455785 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:40:30.455897 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:40:30.457248 (+ 1351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:30.457999 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:30.459332 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:40:30.459798 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:40:30.459941 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:40:30.464637 (+ 4696us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:40:30.464653 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:40:30.464669 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:40:30.464710 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:40:30.467406 (+ 2696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:40:30.468158 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:40:30.468165 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:40:30.468168 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:40:30.468297 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:40:30.468620 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:40:30.468624 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:40:30.468626 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:40:30.468995 (+ 369us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:40:30.469208 (+ 213us) server_negotiation.cc:1035] Waiting for connection context
0619 06:40:30.469476 (+ 268us) server_negotiation.cc:299] Negotiation successful
0619 06:40:30.469654 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260619 06:40:30.470577 22838 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:40:30.560751 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 22715
I20260619 06:40:30.576892 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 22320
I20260619 06:40:30.578088 22382 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:40:30.691576 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 22320
I20260619 06:40:30.716590 11009 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260619 06:40:31.052744 11009 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260619 06:40:31.053013 11009 mini_ranger.cc:66] Stopping Ranger...
I20260619 06:40:31.398924 11009 mini_ranger.cc:68] Stopped Ranger
2026-06-19 06:40:31.399 UTC [21906] LOG: received smart shutdown request
2026-06-19 06:40:31.402 UTC [21906] LOG: background worker "logical replication launcher" (PID 21915) exited with exit code 1
2026-06-19 06:40:31.402 UTC [21910] LOG: shutting down
2026-06-19 06:40:31.578 UTC [21906] LOG: database system is shut down
2026-06-19T06:40:31Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (50820 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:40:31 dist-test-slave-7lz4 krb5kdc[22902](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:40:31 dist-test-slave-7lz4 krb5kdc[22902](info): set up 2 sockets
Jun 19 06:40:31 dist-test-slave-7lz4 krb5kdc[22902](info): commencing operation
krb5kdc: starting...
W20260619 06:40:32.828002 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.000s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:40:32 dist-test-slave-7lz4 krb5kdc[22902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851232, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:40:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:40:32Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.10.192.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.10.192.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.10.192.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/rangeradmin_127.10.192.84@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.10.192.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/rangeradmin_127.10.192.84@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.10.192.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.10.192.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.10.192.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/rangerlookup_127.10.192.84@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.10.192.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/rangerlookup_127.10.192.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.192.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.10.192.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.192.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/HTTP_127.10.192.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.192.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/HTTP_127.10.192.84@KRBTEST.COM.keytab.
I20260619 06:40:33.154048 11009 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskx_grPe/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/postgres -l logfile start
2026-06-19 06:40:35.706 UTC [22932] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-06-19 06:40:35.706 UTC [22932] LOG: listening on IPv4 address "127.10.192.84", port 37005
2026-06-19 06:40:35.710 UTC [22932] LOG: listening on Unix socket "/tmp/.s.PGSQL.37005"
2026-06-19 06:40:35.731 UTC [22935] LOG: database system was shut down at 2026-06-19 06:40:34 UTC
2026-06-19 06:40:35.735 UTC [22932] LOG: database system is ready to accept connections
I20260619 06:40:36.712157 11009 mini_postgres.cc:96] Postgres bound to 37005
2026-06-19 06:40:36.729 UTC [22943] FATAL: database "slave" does not exist
127.10.192.84:37005 - accepting connections
I20260619 06:40:36.729843 11009 mini_ranger.cc:161] Starting Ranger...
I20260619 06:40:36.756614 11009 mini_ranger.cc:84] Created miniranger Postgres user
I20260619 06:40:37.254242 11009 mini_ranger.cc:87] Created ranger Postgres database
I20260619 06:40:37.254390 11009 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ranger-admin
2026-06-19 06:40:37,562 [I] DB FLAVOR :POSTGRES
2026-06-19 06:40:37,563 [I] --------- Verifying Ranger DB connection ---------
2026-06-19 06:40:37,563 [I] Checking connection..
2026-06-19 06:40:37,563 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-06-19 06:40:37,835 [I] Checking connection passed.
2026-06-19 06:40:37,836 [I] --------- Verifying version history table ---------
2026-06-19 06:40:37,836 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-19 06:40:38,117 [I] Table x_db_version_h does not exist in database ranger
2026-06-19 06:40:38,117 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-19 06:40:38,372 [I] Table x_db_version_h does not exist in database ranger
2026-06-19 06:40:38,372 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-06-19 06:40:38,373 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-06-19 06:40:38.612 UTC [23007] WARNING: there is no transaction in progress
2026-06-19 06:40:38,618 [I] create_dbversion_catalog.sql file imported successfully
2026-06-19 06:40:38,619 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-06-19 06:40:38,863 [I] Table x_db_version_h already exists in database 'ranger'
2026-06-19 06:40:38,863 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-19 06:40:38,863 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-06-19 06:40:39,119 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-06-19 06:40:39,373 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7lz4.c.gcp-upstream.internal','N') ;"
2026-06-19 06:40:39,636 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-19 06:40:39,912 [I] Table x_portal_user does not exist in database ranger
2026-06-19 06:40:39,912 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-19 06:40:40,157 [I] Table x_policy_ref_group does not exist in database ranger
2026-06-19 06:40:40,157 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-19 06:40:40,407 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-19 06:40:40,647 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-06-19 06:40:40,647 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-06-19 06:40:41.674 UTC [23115] WARNING: there is no transaction in progress
2026-06-19 06:40:41.691 UTC [23115] WARNING: there is no transaction in progress
2026-06-19 06:40:41.709 UTC [23115] WARNING: there is no transaction in progress
2026-06-19 06:40:41.726 UTC [23115] WARNING: there is no transaction in progress
2026-06-19 06:40:41.746 UTC [23115] WARNING: there is no transaction in progress
2026-06-19 06:40:41.767 UTC [23115] WARNING: there is no transaction in progress
2026-06-19 06:40:41.824 UTC [23115] WARNING: there is no transaction in progress
2026-06-19 06:40:41.831 UTC [23115] WARNING: there is no transaction in progress
2026-06-19 06:40:41.846 UTC [23115] WARNING: there is no transaction in progress
2026-06-19 06:40:41.857 UTC [23115] WARNING: there is no transaction in progress
2026-06-19 06:40:41.868 UTC [23115] WARNING: there is no transaction in progress
2026-06-19 06:40:41.884 UTC [23115] WARNING: there is no transaction in progress
2026-06-19 06:40:41.895 UTC [23115] WARNING: there is no transaction in progress
2026-06-19 06:40:41.903 UTC [23115] WARNING: there is no transaction in progress
2026-06-19 06:40:41.910 UTC [23115] WARNING: there is no transaction in progress
2026-06-19 06:40:41.917 UTC [23115] WARNING: there is no transaction in progress
2026-06-19 06:40:42,593 [I] ranger_core_db_postgres.sql file imported successfully
2026-06-19 06:40:42,594 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-06-19 06:40:42,834 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-06-19 06:40:42,835 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-06-19 06:40:43,094 [I] Table x_portal_user already exists in database 'ranger'
2026-06-19 06:40:43,094 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-06-19 06:40:43,365 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-06-19 06:40:43,365 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-06-19 06:40:43,653 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-06-19 06:40:43,888 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7lz4.c.gcp-upstream.internal';"
2026-06-19 06:40:44,148 [I] CORE_DB_SCHEMA import status has been updated
2026-06-19 06:40:44,148 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-06-19 06:40:44,401 [I] DB_PATCHES have already been applied
I20260619 06:40:44.408152 11009 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ranger-admin:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskx_grPe/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260619 06:40:44.408264 11009 mini_ranger.cc:193] Using host: 127.10.192.84
I20260619 06:40:44.422596 11009 mini_ranger.cc:227] Ranger admin URL: http://127.10.192.84:49997
Jun 19, 2026 6:40:44 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 19, 2026 6:40:44 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 19, 2026 6:40:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ranger-admin/ews/webapp
Jun 19, 2026 6:40:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Jun 19, 2026 6:40:44 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ranger-admin/ews/webapp] .....
Jun 19, 2026 6:40:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ranger-admin/ews/webapp].
Jun 19, 2026 6:40:45 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260619 06:40:45.572032 11009 mini_ranger.cc:160] Time spent starting Ranger: real 8.842s user 0.002s sys 0.037s
Jun 19, 2026 6:41:05 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Jun 19, 2026 6:41:05 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Jun 19, 2026 6:41:05 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Jun 19, 2026 6:41:05 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Jun 19, 2026 6:41:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Jun 19, 2026 6:41:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Jun 19, 2026 6:41:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Jun 19, 2026 6:41:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Jun 19, 2026 6:41:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Jun 19, 2026 6:41:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Jun 19, 2026 6:41:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Jun 19, 2026 6:41:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Jun 19, 2026 6:41:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Jun 19, 2026 6:41:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Jun 19, 2026 6:41:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Jun 19, 2026 6:41:05 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Jun 19, 2026 6:41:05 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Jun 19, 2026 6:41:06 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260619 06:41:06.803726 11009 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.10.192.84@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.10.192.84@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.10.192.84@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/rangerkms_127.10.192.84@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.10.192.84@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/rangerkms_127.10.192.84@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.10.192.84@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.10.192.84@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.10.192.84@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/HTTP_127.10.192.84@KRBTEST.COM.keytab.
Entry for principal HTTP/127.10.192.84@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/HTTP_127.10.192.84@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Jun 19 06:41:06 dist-test-slave-7lz4 krb5kdc[22902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851266, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260619 06:41:06.972504 11009 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260619 06:41:06.996505 11009 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260619 06:41:07.879989 11009 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260619 06:41:07.880086 11009 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ranger-kms
I20260619 06:41:07.880149 11009 mini_ranger_kms.cc:227] Using postgres at 127.10.192.84:37005
2026-06-19 06:41:08,229 [I] DB FLAVOR :POSTGRES
2026-06-19 06:41:08,229 [I] --------- Verifying Ranger DB connection ---------
2026-06-19 06:41:08,229 [I] Checking connection
2026-06-19 06:41:08,229 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-06-19 06:41:08,495 [I] connection success
2026-06-19 06:41:08,496 [I] --------- Verifying Ranger DB tables ---------
2026-06-19 06:41:08,496 [I] Verifying table ranger_masterkey in database rangerkms
2026-06-19 06:41:08,496 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-06-19 06:41:08,733 [I] Table ranger_masterkey does not exist in database rangerkms
2026-06-19 06:41:08,734 [I] --------- Importing Ranger Core DB Schema ---------
2026-06-19 06:41:08,734 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-06-19 06:41:08,734 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.10.192.84:37005/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-06-19 06:41:08,990 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260619 06:41:09.507968 11009 mini_ranger_kms.cc:310] Created kms service
I20260619 06:41:09.715021 11009 mini_ranger_kms.cc:326] Created kudu user
I20260619 06:41:09.761180 11009 mini_ranger_kms.cc:343] Created rangerkms user
Jun 19 06:41:09 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851266, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
I20260619 06:41:10.152760 11009 mini_ranger_kms.cc:384] Added ranger policy
I20260619 06:41:10.153158 11009 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ranger-kms:/tmp/dist-test-taskx_grPe/build/asan/bin/postgresql.jar:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskx_grPe/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260619 06:41:10.153220 11009 mini_ranger_kms.cc:240] Using host: 127.10.192.84
I20260619 06:41:10.171564 11009 mini_ranger_kms.cc:276] Ranger KMS PID: 23295
I20260619 06:41:10.171756 11009 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.10.192.84:44941
Jun 19, 2026 6:41:11 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Jun 19, 2026 6:41:11 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Jun 19, 2026 6:41:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Jun 19, 2026 6:41:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ranger-kms/ews/webapp] .....
Jun 19, 2026 6:41:11 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ranger-kms/ews/webapp].
Jun 19, 2026 6:41:11 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Jun 19 06:41:12 dist-test-slave-7lz4 krb5kdc[22902](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781851272, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.192.84@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:12.500368 11009 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.528s user 0.096s sys 0.271s
I20260619 06:41:12.500626 11009 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260619 06:41:12.500813 11009 mini_ranger_kms.cc:401] 127.10.192.84:44941/kms/v1/keys
Jun 19 06:41:12 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851272, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.192.84@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
Jun 19 06:41:13 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851272, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.10.192.84@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
Jun 19 06:41:15 dist-test-slave-7lz4 krb5kdc[22902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:41:15.615061 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:32949
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:43743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:32949
--ranger_config_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.192.84:44941/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:41:15.956130 23346 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:15.956661 23346 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:15.956843 23346 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:15.964416 23346 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:41:15.964576 23346 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:15.964691 23346 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:15.964797 23346 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:41:15.964890 23346 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:41:15.975320 23346 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:43743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/wal
--ranger_kms_url=127.10.192.84:44941/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:32949
--ranger_config_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:32949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:15.976732 23346 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:15.978150 23346 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:15.990674 23352 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:15.990780 23351 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:15.990752 23354 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:15.991413 23346 server_base.cc:1034] running on GCE node
I20260619 06:41:15.992300 23346 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:15.993921 23346 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:15.995154 23346 hybrid_clock.cc:648] HybridClock initialized: now 1781851275995112 us; error 28 us; skew 500 ppm
I20260619 06:41:15.995572 23346 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:15 dist-test-slave-7lz4 krb5kdc[22902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851275, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:15.998955 23346 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:41:16.000674 23346 webserver.cc:460] Webserver started at http://127.10.192.126:43073/ using document root <none> and password file <none>
I20260619 06:41:16.001387 23346 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:16.001526 23346 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:16.001845 23346 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 06:41:16 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851275, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
I20260619 06:41:16.053723 23346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "74a1c3fc9b1d40c092814767a03037b5"
format_stamp: "Formatted at 2026-06-19 06:41:16 on dist-test-slave-7lz4"
server_key: "7395fd8cb8abb7545b9b6fffbe1cbb70"
server_key_iv: "8cb38118460496b21e530962990151d4"
server_key_version: "kuduclusterkey@0"
I20260619 06:41:16.054678 23346 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "74a1c3fc9b1d40c092814767a03037b5"
format_stamp: "Formatted at 2026-06-19 06:41:16 on dist-test-slave-7lz4"
server_key: "7395fd8cb8abb7545b9b6fffbe1cbb70"
server_key_iv: "8cb38118460496b21e530962990151d4"
server_key_version: "kuduclusterkey@0"
I20260619 06:41:16.060575 23346 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260619 06:41:16.077718 23361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:16.079442 23346 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260619 06:41:16.079641 23346 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "74a1c3fc9b1d40c092814767a03037b5"
format_stamp: "Formatted at 2026-06-19 06:41:16 on dist-test-slave-7lz4"
server_key: "7395fd8cb8abb7545b9b6fffbe1cbb70"
server_key_iv: "8cb38118460496b21e530962990151d4"
server_key_version: "kuduclusterkey@0"
I20260619 06:41:16.079895 23346 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:16.095775 23346 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:16.100167 23346 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:16.100519 23346 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:16.119805 23346 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:32949
I20260619 06:41:16.119841 23412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:32949 every 8 connection(s)
I20260619 06:41:16.121236 23346 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:41:16.122406 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 23346
I20260619 06:41:16.122635 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:41:16.123456 11009 external_mini_cluster.cc:1428] Setting key 59bfd7a692819d7e71b145d59436915a
I20260619 06:41:16.126180 23413 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Jun 19 06:41:16 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:16.139688 23413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5: Bootstrap starting.
I20260619 06:41:16.144091 23413 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5: Neither blocks nor log segments found. Creating new log.
I20260619 06:41:16.145437 23413 log.cc:824] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:16.148129 23416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:16.125596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43470 (local address 127.10.192.126:32949)
0619 06:41:16.126398 (+ 802us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:16.126411 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:16.126451 (+ 40us) server_negotiation.cc:407] Connection header received
0619 06:41:16.128106 (+ 1655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:16.128126 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:16.128532 (+ 406us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:16.128877 (+ 345us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:16.130521 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:16.131970 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:16.133835 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:16.134512 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:16.134643 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:16.139327 (+ 4684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:16.139339 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:16.139361 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:16.139413 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:16.143228 (+ 3815us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:16.144040 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:16.144051 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:16.144065 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:16.144276 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:16.144657 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:16.144661 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:16.144664 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:16.145383 (+ 719us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:16.145679 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:16.146177 (+ 498us) server_negotiation.cc:299] Negotiation successful
0619 06:41:16.146664 (+ 487us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":386,"threads_started":1}
I20260619 06:41:16.149122 23413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5: No bootstrap required, opened a new log
I20260619 06:41:16.156618 23413 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74a1c3fc9b1d40c092814767a03037b5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 32949 } }
I20260619 06:41:16.157125 23413 raft_consensus.cc:374] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:41:16.157238 23413 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74a1c3fc9b1d40c092814767a03037b5, State: Initialized, Role: FOLLOWER
I20260619 06:41:16.157899 23413 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74a1c3fc9b1d40c092814767a03037b5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 32949 } }
I20260619 06:41:16.158113 23413 raft_consensus.cc:388] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:41:16.158212 23413 raft_consensus.cc:482] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:41:16.158356 23413 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:41:16.160487 23413 raft_consensus.cc:504] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74a1c3fc9b1d40c092814767a03037b5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 32949 } }
I20260619 06:41:16.160941 23413 leader_election.cc:302] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74a1c3fc9b1d40c092814767a03037b5; no voters:
I20260619 06:41:16.161654 23413 leader_election.cc:288] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:41:16.161760 23418 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:41:16.162453 23418 raft_consensus.cc:686] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [term 1 LEADER]: Becoming Leader. State: Replica: 74a1c3fc9b1d40c092814767a03037b5, State: Running, Role: LEADER
I20260619 06:41:16.162976 23418 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74a1c3fc9b1d40c092814767a03037b5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 32949 } }
I20260619 06:41:16.164031 23413 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:41:16.166105 23419 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74a1c3fc9b1d40c092814767a03037b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74a1c3fc9b1d40c092814767a03037b5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 32949 } } }
I20260619 06:41:16.166391 23420 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74a1c3fc9b1d40c092814767a03037b5. Latest consensus state: current_term: 1 leader_uuid: "74a1c3fc9b1d40c092814767a03037b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74a1c3fc9b1d40c092814767a03037b5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 32949 } } }
I20260619 06:41:16.166589 23419 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [sys.catalog]: This master's current role is: LEADER
I20260619 06:41:16.166663 23420 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [sys.catalog]: This master's current role is: LEADER
I20260619 06:41:16.167420 23425 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:41:16.178591 23425 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:41:16.179426 23413 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260619 06:41:16.197595 23425 catalog_manager.cc:1347] Generated new cluster ID: 4f6c42837d764ee283deeb53aabded6f
I20260619 06:41:16.197793 23425 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:41:16.208986 23425 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:41:16.210458 23425 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:41:16.219815 23425 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5: Generated new TSK 0
I20260619 06:41:16.220780 23425 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
I20260619 06:41:16.980170 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.192.84:44941/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:32949
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:43743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 06:41:17 dist-test-slave-7lz4 krb5kdc[22902](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781851277, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260619 06:41:17.431056 23458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:17.431499 23458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:17.431716 23458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:17.443455 23458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:17.443598 23458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:17.443810 23458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:41:17.456756 23458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:43743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.10.192.84:44941/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:32949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:17.458293 23458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:17.460122 23458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:17.480094 23468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:17.480840 23469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:17.482743 23458 server_base.cc:1034] running on GCE node
W20260619 06:41:17.483048 23471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:17.483883 23458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:17.485144 23458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:17.486387 23458 hybrid_clock.cc:648] HybridClock initialized: now 1781851277486315 us; error 74 us; skew 500 ppm
I20260619 06:41:17.486752 23458 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:17 dist-test-slave-7lz4 krb5kdc[22902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851277, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:17.490089 23458 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:41:17.497080 23458 webserver.cc:460] Webserver started at http://127.10.192.65:36619/ using document root <none> and password file <none>
I20260619 06:41:17.498075 23458 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:17.498214 23458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:17.498584 23458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 06:41:17 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851277, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
I20260619 06:41:17.521996 23458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "d492861751d942c5bbbfc01046cd1fb8"
format_stamp: "Formatted at 2026-06-19 06:41:17 on dist-test-slave-7lz4"
server_key: "1f5809de6999441d8ef8d7d894176082"
server_key_iv: "5fce9a8d05409698e92a2dec731fcb2e"
server_key_version: "kuduclusterkey@0"
I20260619 06:41:17.522950 23458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "d492861751d942c5bbbfc01046cd1fb8"
format_stamp: "Formatted at 2026-06-19 06:41:17 on dist-test-slave-7lz4"
server_key: "1f5809de6999441d8ef8d7d894176082"
server_key_iv: "5fce9a8d05409698e92a2dec731fcb2e"
server_key_version: "kuduclusterkey@0"
I20260619 06:41:17.528729 23458 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260619 06:41:17.552670 23478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:17.554836 23458 fs_manager.cc:725] Time spent opening block manager: real 0.009s user 0.002s sys 0.006s
I20260619 06:41:17.555076 23458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "d492861751d942c5bbbfc01046cd1fb8"
format_stamp: "Formatted at 2026-06-19 06:41:17 on dist-test-slave-7lz4"
server_key: "1f5809de6999441d8ef8d7d894176082"
server_key_iv: "5fce9a8d05409698e92a2dec731fcb2e"
server_key_version: "kuduclusterkey@0"
I20260619 06:41:17.555359 23458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:17.600384 23458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:17.605576 23458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:17.605938 23458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:17.607144 23458 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:41:17.608918 23458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:41:17.609010 23458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:17.609144 23458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:41:17.609205 23458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:17.674049 23458 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:40651
I20260619 06:41:17.674073 23590 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:40651 every 8 connection(s)
I20260619 06:41:17.675802 23458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:41:17.686281 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 23458
I20260619 06:41:17.686506 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:41:17.687340 11009 external_mini_cluster.cc:1428] Setting key 357223f443b36e37a4d2fdf2be3d4aa8
Jun 19 06:41:17 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851277, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.192.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.66@KRBTEST.COM" created.
I20260619 06:41:17.735364 23594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:17.686532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:47663 (local address 127.10.192.126:32949)
0619 06:41:17.713407 (+ 26875us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:17.713416 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:17.713442 (+ 26us) server_negotiation.cc:407] Connection header received
0619 06:41:17.713513 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:17.713518 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:17.713626 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:17.713754 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:17.717269 (+ 3515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:17.718505 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:17.721076 (+ 2571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:17.721748 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:17.721860 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:17.726955 (+ 5095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:17.726963 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:17.726969 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:17.727016 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:17.731024 (+ 4008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:17.732341 (+ 1317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:17.732347 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:17.732351 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:17.732533 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:17.733130 (+ 597us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:17.733136 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:17.733140 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:17.733537 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:17.733676 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:17.734730 (+ 1054us) server_negotiation.cc:299] Negotiation successful
0619 06:41:17.734968 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26721,"thread_start_us":29325,"threads_started":1}
I20260619 06:41:17.737782 23593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:17.685718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:32949 (local address 127.10.192.65:47663)
0619 06:41:17.708390 (+ 22672us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:17.708460 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:17.711162 (+ 2702us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:17.714278 (+ 3116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:17.714293 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:17.715063 (+ 770us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:17.716998 (+ 1935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:17.717028 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:17.718752 (+ 1724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:17.718758 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:17.720882 (+ 2124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:17.720899 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:17.722245 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:17.722265 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:17.722586 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:17.723502 (+ 916us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:17.723535 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:17.726619 (+ 3084us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:17.731282 (+ 4663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:17.731293 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:17.731315 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:17.732091 (+ 776us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:17.732691 (+ 600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:17.732696 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:17.732700 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:17.732978 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:17.733782 (+ 804us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:17.733791 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:17.734267 (+ 476us) client_negotiation.cc:769] Sending connection context
0619 06:41:17.735713 (+ 1446us) client_negotiation.cc:240] Negotiation successful
0619 06:41:17.736308 (+ 595us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22273,"thread_start_us":21977,"threads_started":1}
I20260619 06:41:17.739923 23591 heartbeater.cc:347] Connected to a master server at 127.10.192.126:32949
I20260619 06:41:17.740283 23591 heartbeater.cc:464] Registering TS with master...
I20260619 06:41:17.741222 23591 heartbeater.cc:511] Master 127.10.192.126:32949 requested a full tablet report, sending...
I20260619 06:41:17.743862 23378 ts_manager.cc:194] Registered new tserver with Master: d492861751d942c5bbbfc01046cd1fb8 (127.10.192.65:40651)
I20260619 06:41:17.745896 23378 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:47663
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
I20260619 06:41:17.775581 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.192.84:44941/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:32949
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:43743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 06:41:17 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851277, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
Jun 19 06:41:18 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851277, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
W20260619 06:41:18.266892 23597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:18.267349 23597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:18.267517 23597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:18.279441 23597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:18.279618 23597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:18.279886 23597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:41:18.294407 23597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:43743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.10.192.84:44941/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:32949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:18.296485 23597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:18.298297 23597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:18.339470 23604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:18.344058 23605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:18.349361 23597 server_base.cc:1034] running on GCE node
W20260619 06:41:18.349879 23608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:18.350646 23597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:18.351807 23597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:18.353070 23597 hybrid_clock.cc:648] HybridClock initialized: now 1781851278353004 us; error 64 us; skew 500 ppm
I20260619 06:41:18.353421 23597 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:18 dist-test-slave-7lz4 krb5kdc[22902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851278, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:18.356762 23597 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:41:18.358898 23597 webserver.cc:460] Webserver started at http://127.10.192.66:38025/ using document root <none> and password file <none>
I20260619 06:41:18.359727 23597 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:18.359863 23597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:18.360209 23597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 06:41:18 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851278, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
I20260619 06:41:18.375120 23597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "5e7f6e467dfd43f988d8745a9159dd32"
format_stamp: "Formatted at 2026-06-19 06:41:18 on dist-test-slave-7lz4"
server_key: "0f4fc474b320c680149cf2b462929b14"
server_key_iv: "86d7f81dfdd8f001aebca2422245faa7"
server_key_version: "kuduclusterkey@0"
I20260619 06:41:18.376372 23597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "5e7f6e467dfd43f988d8745a9159dd32"
format_stamp: "Formatted at 2026-06-19 06:41:18 on dist-test-slave-7lz4"
server_key: "0f4fc474b320c680149cf2b462929b14"
server_key_iv: "86d7f81dfdd8f001aebca2422245faa7"
server_key_version: "kuduclusterkey@0"
I20260619 06:41:18.384687 23597 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.005s sys 0.001s
I20260619 06:41:18.419579 23616 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:18.421823 23597 fs_manager.cc:725] Time spent opening block manager: real 0.015s user 0.009s sys 0.004s
I20260619 06:41:18.422098 23597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "5e7f6e467dfd43f988d8745a9159dd32"
format_stamp: "Formatted at 2026-06-19 06:41:18 on dist-test-slave-7lz4"
server_key: "0f4fc474b320c680149cf2b462929b14"
server_key_iv: "86d7f81dfdd8f001aebca2422245faa7"
server_key_version: "kuduclusterkey@0"
I20260619 06:41:18.422438 23597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:18.440930 23597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:18.445573 23597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:18.446012 23597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:18.447304 23597 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:41:18.448985 23597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:41:18.449057 23597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:18.449148 23597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:41:18.449195 23597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:18.482242 23597 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:38989
I20260619 06:41:18.482265 23733 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:38989 every 8 connection(s)
I20260619 06:41:18.483695 23597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:41:18.490453 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 23597
I20260619 06:41:18.490649 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:41:18.491091 11009 external_mini_cluster.cc:1428] Setting key 2565ee5e990aecaa3eb6d89e48b8b13e
Jun 19 06:41:18 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851278, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:18.504279 23736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:18.486393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:42887 (local address 127.10.192.126:32949)
0619 06:41:18.486919 (+ 526us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:18.486924 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:18.487686 (+ 762us) server_negotiation.cc:407] Connection header received
0619 06:41:18.489639 (+ 1953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:18.489645 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:18.489737 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:18.489880 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:18.491461 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:18.492458 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:18.494089 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:18.494536 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:18.494681 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:18.498179 (+ 3498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:18.498184 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:18.498188 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:18.498220 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:18.501061 (+ 2841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:18.501854 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:18.501859 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:18.501863 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:18.501995 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:18.502448 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:18.502455 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:18.502458 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:18.502747 (+ 289us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:18.502902 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:18.503600 (+ 698us) server_negotiation.cc:299] Negotiation successful
0619 06:41:18.503867 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":409,"thread_start_us":309,"threads_started":1}
I20260619 06:41:18.505281 23737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:18.486740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:32949 (local address 127.10.192.66:42887)
0619 06:41:18.487483 (+ 743us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:18.487527 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:18.489342 (+ 1815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:18.490134 (+ 792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:18.490142 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:18.490562 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:18.491292 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:18.491311 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:18.492643 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:18.492649 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:18.493939 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:18.493951 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:18.494773 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:18.494780 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:18.495018 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:18.495822 (+ 804us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:18.495845 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:18.497929 (+ 2084us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:18.501238 (+ 3309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:18.501247 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:18.501266 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:18.501726 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:18.502120 (+ 394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:18.502125 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:18.502129 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:18.502336 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:18.502884 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:18.502893 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:18.503231 (+ 338us) client_negotiation.cc:769] Sending connection context
0619 06:41:18.503508 (+ 277us) client_negotiation.cc:240] Negotiation successful
0619 06:41:18.504089 (+ 581us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":315,"threads_started":1}
I20260619 06:41:18.506906 23734 heartbeater.cc:347] Connected to a master server at 127.10.192.126:32949
I20260619 06:41:18.507300 23734 heartbeater.cc:464] Registering TS with master...
I20260619 06:41:18.508240 23734 heartbeater.cc:511] Master 127.10.192.126:32949 requested a full tablet report, sending...
I20260619 06:41:18.510071 23378 ts_manager.cc:194] Registered new tserver with Master: 5e7f6e467dfd43f988d8745a9159dd32 (127.10.192.66:38989)
I20260619 06:41:18.511346 23378 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:42887
WARNING: no policy specified for kudu/127.10.192.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
I20260619 06:41:18.542837 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.192.84:44941/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:32949
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:43743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:41:18.750030 23591 heartbeater.cc:503] Master 127.10.192.126:32949 was elected leader, sending a full tablet report...
W20260619 06:41:18.878319 23740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:18.878651 23740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:18.878858 23740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:18.886451 23740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:18.886602 23740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:18.886754 23740 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:41:18.896730 23740 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:43743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.10.192.84:44941/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:32949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:18.898124 23740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:18.899401 23740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:18.913100 23748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:18.913060 23745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:18.913075 23746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:18.917177 23740 server_base.cc:1034] running on GCE node
I20260619 06:41:18.917783 23740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:18.918744 23740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:18.919955 23740 hybrid_clock.cc:648] HybridClock initialized: now 1781851278919912 us; error 35 us; skew 500 ppm
I20260619 06:41:18.920292 23740 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:18 dist-test-slave-7lz4 krb5kdc[22902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851278, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:18.928251 23740 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:41:18.929888 23740 webserver.cc:460] Webserver started at http://127.10.192.67:44581/ using document root <none> and password file <none>
I20260619 06:41:18.930639 23740 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:18.930797 23740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:18.931121 23740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Jun 19 06:41:18 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851278, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
I20260619 06:41:18.945591 23740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "da7e6b3d1f2b424590aff07db713104c"
format_stamp: "Formatted at 2026-06-19 06:41:18 on dist-test-slave-7lz4"
server_key: "0437da40f702ec6d18d2a31a52e459a7"
server_key_iv: "5452dea75084a3c9b772a6049df8c669"
server_key_version: "kuduclusterkey@0"
I20260619 06:41:18.946476 23740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "da7e6b3d1f2b424590aff07db713104c"
format_stamp: "Formatted at 2026-06-19 06:41:18 on dist-test-slave-7lz4"
server_key: "0437da40f702ec6d18d2a31a52e459a7"
server_key_iv: "5452dea75084a3c9b772a6049df8c669"
server_key_version: "kuduclusterkey@0"
I20260619 06:41:18.952226 23740 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260619 06:41:18.967464 23755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:18.969086 23740 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:41:18.969246 23740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "da7e6b3d1f2b424590aff07db713104c"
format_stamp: "Formatted at 2026-06-19 06:41:18 on dist-test-slave-7lz4"
server_key: "0437da40f702ec6d18d2a31a52e459a7"
server_key_iv: "5452dea75084a3c9b772a6049df8c669"
server_key_version: "kuduclusterkey@0"
I20260619 06:41:18.969447 23740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:18.991618 23740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:18.995908 23740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:18.996160 23740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:18.997061 23740 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:41:18.998456 23740 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:41:18.998534 23740 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:18.998617 23740 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:41:18.998660 23740 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:19.031601 23740 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:38329
I20260619 06:41:19.031677 23867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:38329 every 8 connection(s)
I20260619 06:41:19.033005 23740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:41:19.036715 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 23740
I20260619 06:41:19.036916 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:41:19.037513 11009 external_mini_cluster.cc:1428] Setting key 2e1df06add28c64732f8893078ce738d
Jun 19 06:41:19 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851278, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:19.053524 23870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:19.035567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:50639 (local address 127.10.192.126:32949)
0619 06:41:19.036089 (+ 522us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:19.036095 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:19.037234 (+ 1139us) server_negotiation.cc:407] Connection header received
0619 06:41:19.039583 (+ 2349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:19.039588 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:19.039738 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:19.039867 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:19.041512 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:19.042244 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:19.043944 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:19.044395 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:19.044505 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:19.047613 (+ 3108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:19.047617 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:19.047620 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:19.047707 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:19.050385 (+ 2678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:19.051101 (+ 716us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:19.051108 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:19.051111 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:19.051242 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:19.051717 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:19.051721 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:19.051723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:19.052100 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:19.052215 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:19.053015 (+ 800us) server_negotiation.cc:299] Negotiation successful
0619 06:41:19.053235 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":266,"threads_started":1}
I20260619 06:41:19.054504 23871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:19.036168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:32949 (local address 127.10.192.67:50639)
0619 06:41:19.037038 (+ 870us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:19.037102 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:19.039258 (+ 2156us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:19.040123 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:19.040132 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:19.040646 (+ 514us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:19.041346 (+ 700us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:19.041364 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:19.042422 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:19.042428 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:19.043799 (+ 1371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:19.043815 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:19.044597 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:19.044602 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:19.044795 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:19.045395 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:19.045417 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:19.047401 (+ 1984us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:19.050543 (+ 3142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:19.050551 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:19.050569 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:19.050976 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:19.051349 (+ 373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:19.051355 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:19.051359 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:19.051585 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:19.052233 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:19.052241 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:19.052573 (+ 332us) client_negotiation.cc:769] Sending connection context
0619 06:41:19.052890 (+ 317us) client_negotiation.cc:240] Negotiation successful
0619 06:41:19.053400 (+ 510us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":312,"threads_started":1}
I20260619 06:41:19.055907 23868 heartbeater.cc:347] Connected to a master server at 127.10.192.126:32949
I20260619 06:41:19.056159 23868 heartbeater.cc:464] Registering TS with master...
I20260619 06:41:19.056769 23868 heartbeater.cc:511] Master 127.10.192.126:32949 requested a full tablet report, sending...
I20260619 06:41:19.058056 23378 ts_manager.cc:194] Registered new tserver with Master: da7e6b3d1f2b424590aff07db713104c (127.10.192.67:38329)
I20260619 06:41:19.058804 23378 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:50639
I20260619 06:41:19.065543 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 06:41:19.067178 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 23458
Jun 19 06:41:19 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:41:19.083271 23873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:19.068176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43106 (local address 127.10.192.65:40651)
0619 06:41:19.068769 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:19.068775 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:19.068800 (+ 25us) server_negotiation.cc:407] Connection header received
0619 06:41:19.068862 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:19.068868 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:19.069065 (+ 197us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:19.069193 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:19.070566 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:19.071575 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:19.073233 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:19.073902 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:19.074000 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:19.078254 (+ 4254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:19.078266 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:19.078280 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:19.078313 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:19.080948 (+ 2635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:19.081579 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:19.081586 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:19.081588 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:19.081726 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:19.082029 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:19.082032 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:19.082034 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:19.082347 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:19.082559 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:19.082803 (+ 244us) server_negotiation.cc:299] Negotiation successful
0619 06:41:19.082987 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":300,"threads_started":1}
I20260619 06:41:19.084658 23586 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:19.173995 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 23458
I20260619 06:41:19.190572 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 23597
Jun 19 06:41:19 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.66@KRBTEST.COM
I20260619 06:41:19.206526 23875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:19.191556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44428 (local address 127.10.192.66:38989)
0619 06:41:19.192197 (+ 641us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:19.192205 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:19.192229 (+ 24us) server_negotiation.cc:407] Connection header received
0619 06:41:19.192288 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:19.192294 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:19.192511 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:19.192639 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:19.193799 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:19.194760 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:19.196166 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:19.196697 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:19.196791 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:19.201149 (+ 4358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:19.201160 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:19.201175 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:19.201220 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:19.203951 (+ 2731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:19.204614 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:19.204620 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:19.204622 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:19.204796 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:19.205210 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:19.205213 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:19.205215 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:19.205537 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:19.205751 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:19.206036 (+ 285us) server_negotiation.cc:299] Negotiation successful
0619 06:41:19.206241 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":486,"thread_start_us":381,"threads_started":1}
I20260619 06:41:19.207932 23729 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:19.290355 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 23597
I20260619 06:41:19.312423 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 23740
Jun 19 06:41:19 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851275, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.67@KRBTEST.COM
I20260619 06:41:19.329686 23877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:19.313516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55020 (local address 127.10.192.67:38329)
0619 06:41:19.314119 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:19.314127 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:19.314155 (+ 28us) server_negotiation.cc:407] Connection header received
0619 06:41:19.314213 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:19.314220 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:19.314431 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:19.314603 (+ 172us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:19.315995 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:19.317017 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:19.318354 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:19.318941 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:19.319078 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:19.324115 (+ 5037us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:19.324126 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:19.324142 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:19.324175 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:19.327105 (+ 2930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:19.327871 (+ 766us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:19.327878 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:19.327880 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:19.327999 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:19.328338 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:19.328341 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:19.328343 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:19.328702 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:19.328932 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:19.329173 (+ 241us) server_negotiation.cc:299] Negotiation successful
0619 06:41:19.329373 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":303,"threads_started":1}
I20260619 06:41:19.330940 23863 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:19.414945 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 23740
I20260619 06:41:19.430351 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 23346
I20260619 06:41:19.431696 23408 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:19.540324 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 23346
I20260619 06:41:19.562968 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:32949
--webserver_interface=127.10.192.126
--webserver_port=43073
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:43743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:32949
--ranger_config_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.192.84:44941/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.192.84:44941/kms with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:41:19.899991 23880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:19.900343 23880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:19.900527 23880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:19.908082 23880 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:41:19.908243 23880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:19.908368 23880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:19.908478 23880 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:41:19.908578 23880 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:41:19.919256 23880 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:43743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.192.84:44941/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:32949
--ranger_config_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:32949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=43073
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:19.920679 23880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:19.922185 23880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:19.934962 23886 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:19.934868 23888 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:19.935205 23885 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:19.935834 23880 server_base.cc:1034] running on GCE node
I20260619 06:41:19.936725 23880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:19.938213 23880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:19.939446 23880 hybrid_clock.cc:648] HybridClock initialized: now 1781851279939403 us; error 61 us; skew 500 ppm
I20260619 06:41:19.939864 23880 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:19 dist-test-slave-7lz4 krb5kdc[22902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851279, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:19.942896 23880 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:41:19.944411 23880 webserver.cc:460] Webserver started at http://127.10.192.126:43073/ using document root <none> and password file <none>
I20260619 06:41:19.945093 23880 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:19.945245 23880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 19 06:41:20 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851279, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
I20260619 06:41:20.031840 23880 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.004s
I20260619 06:41:20.035015 23896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:20.036566 23880 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:41:20.036801 23880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "74a1c3fc9b1d40c092814767a03037b5"
format_stamp: "Formatted at 2026-06-19 06:41:16 on dist-test-slave-7lz4"
server_key: "7395fd8cb8abb7545b9b6fffbe1cbb70"
server_key_iv: "8cb38118460496b21e530962990151d4"
server_key_version: "kuduclusterkey@0"
I20260619 06:41:20.037856 23880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:20.053431 23880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:20.057683 23880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:20.058000 23880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:20.076699 23880 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:32949
I20260619 06:41:20.076717 23947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:32949 every 8 connection(s)
I20260619 06:41:20.078336 23880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:41:20.085167 23948 sys_catalog.cc:263] Verifying existing consensus state
I20260619 06:41:20.088152 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 23880
I20260619 06:41:20.088891 23948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5: Bootstrap starting.
I20260619 06:41:20.089234 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.192.84:44941/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:40651
--local_ip_for_outbound_sockets=127.10.192.65
--tserver_master_addrs=127.10.192.126:32949
--webserver_port=36619
--webserver_interface=127.10.192.65
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:43743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.192.84:44941/kms with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:41:20.110540 23948 log.cc:824] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:20.120082 23948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 06:41:20.120640 23948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5: Bootstrap complete.
I20260619 06:41:20.130091 23948 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74a1c3fc9b1d40c092814767a03037b5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 32949 } }
I20260619 06:41:20.130923 23948 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74a1c3fc9b1d40c092814767a03037b5, State: Initialized, Role: FOLLOWER
I20260619 06:41:20.131615 23948 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74a1c3fc9b1d40c092814767a03037b5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 32949 } }
I20260619 06:41:20.131930 23948 raft_consensus.cc:388] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:41:20.132067 23948 raft_consensus.cc:482] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:41:20.132261 23948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [term 1 FOLLOWER]: Advancing to term 2
I20260619 06:41:20.136155 23948 raft_consensus.cc:504] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74a1c3fc9b1d40c092814767a03037b5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 32949 } }
I20260619 06:41:20.136667 23948 leader_election.cc:302] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74a1c3fc9b1d40c092814767a03037b5; no voters:
I20260619 06:41:20.137342 23948 leader_election.cc:288] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260619 06:41:20.137501 23952 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 06:41:20.138746 23952 raft_consensus.cc:686] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [term 2 LEADER]: Becoming Leader. State: Replica: 74a1c3fc9b1d40c092814767a03037b5, State: Running, Role: LEADER
I20260619 06:41:20.139386 23952 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74a1c3fc9b1d40c092814767a03037b5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 32949 } }
I20260619 06:41:20.139739 23948 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:41:20.142169 23954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74a1c3fc9b1d40c092814767a03037b5. Latest consensus state: current_term: 2 leader_uuid: "74a1c3fc9b1d40c092814767a03037b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74a1c3fc9b1d40c092814767a03037b5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 32949 } } }
I20260619 06:41:20.142545 23954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [sys.catalog]: This master's current role is: LEADER
I20260619 06:41:20.143150 23953 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "74a1c3fc9b1d40c092814767a03037b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74a1c3fc9b1d40c092814767a03037b5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 32949 } } }
I20260619 06:41:20.143433 23953 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5 [sys.catalog]: This master's current role is: LEADER
I20260619 06:41:20.154278 23958 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:41:20.160316 23958 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:41:20.161787 23958 catalog_manager.cc:1259] Loaded cluster ID: 4f6c42837d764ee283deeb53aabded6f
I20260619 06:41:20.161959 23958 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:41:20.165962 23958 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:41:20.167498 23958 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5: Loaded TSK: 0
I20260619 06:41:20.169291 23958 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:41:20.172397 23948 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260619 06:41:20.559242 23950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:20.559839 23950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:20.560065 23950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:20.572032 23950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:20.572296 23950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:20.572572 23950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:41:20.589267 23950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:43743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.192.84:44941/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:40651
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=36619
--tserver_master_addrs=127.10.192.126:32949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:20.591414 23950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:20.593401 23950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:20.612821 23985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:20.612761 23986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:20.614562 23988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:20.615716 23950 server_base.cc:1034] running on GCE node
I20260619 06:41:20.616808 23950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:20.618211 23950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:20.619546 23950 hybrid_clock.cc:648] HybridClock initialized: now 1781851280619475 us; error 59 us; skew 500 ppm
I20260619 06:41:20.620047 23950 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:20 dist-test-slave-7lz4 krb5kdc[22902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851280, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:20.627915 23950 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:41:20.630177 23950 webserver.cc:460] Webserver started at http://127.10.192.65:36619/ using document root <none> and password file <none>
I20260619 06:41:20.631815 23950 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:20.632030 23950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 19 06:41:20 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851280, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
I20260619 06:41:20.664372 23950 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.004s
I20260619 06:41:20.672277 23996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:20.674369 23950 fs_manager.cc:725] Time spent opening block manager: real 0.008s user 0.003s sys 0.004s
I20260619 06:41:20.674572 23950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "d492861751d942c5bbbfc01046cd1fb8"
format_stamp: "Formatted at 2026-06-19 06:41:17 on dist-test-slave-7lz4"
server_key: "1f5809de6999441d8ef8d7d894176082"
server_key_iv: "5fce9a8d05409698e92a2dec731fcb2e"
server_key_version: "kuduclusterkey@0"
I20260619 06:41:20.676066 23950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:20.714577 23950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:20.719898 23950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:20.720214 23950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:20.721355 23950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:41:20.722925 23950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:41:20.723047 23950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:20.723183 23950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:41:20.723289 23950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:20.799062 23950 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:40651
I20260619 06:41:20.799117 24109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:40651 every 8 connection(s)
I20260619 06:41:20.800822 23950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:41:20.801975 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 23950
I20260619 06:41:20.802775 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.192.84:44941/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:38989
--local_ip_for_outbound_sockets=127.10.192.66
--tserver_master_addrs=127.10.192.126:32949
--webserver_port=38025
--webserver_interface=127.10.192.66
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:43743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.192.84:44941/kms with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 06:41:20 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851280, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:20.845412 24112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:20.804473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:32949 (local address 127.10.192.65:35829)
0619 06:41:20.813435 (+ 8962us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:20.813496 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:20.816058 (+ 2562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:20.821972 (+ 5914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:20.821987 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:20.822731 (+ 744us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:20.823603 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:20.823664 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:20.826480 (+ 2816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:20.826489 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:20.828981 (+ 2492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:20.829019 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:20.830825 (+ 1806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:20.830834 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:20.831144 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:20.832085 (+ 941us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:20.832118 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:20.834887 (+ 2769us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:20.839675 (+ 4788us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:20.839685 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:20.839704 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:20.840355 (+ 651us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:20.840913 (+ 558us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:20.840918 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:20.840921 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:20.841181 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:20.842340 (+ 1159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:20.842349 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:20.842962 (+ 613us) client_negotiation.cc:769] Sending connection context
0619 06:41:20.843286 (+ 324us) client_negotiation.cc:240] Negotiation successful
0619 06:41:20.843886 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8656,"thread_start_us":8439,"threads_started":1}
I20260619 06:41:20.848060 24113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:20.805673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:35829 (local address 127.10.192.126:32949)
0619 06:41:20.812744 (+ 7071us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:20.812789 (+ 45us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:20.814001 (+ 1212us) server_negotiation.cc:407] Connection header received
0619 06:41:20.820069 (+ 6068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:20.820097 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:20.820705 (+ 608us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:20.821160 (+ 455us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:20.823920 (+ 2760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:20.826255 (+ 2335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:20.829237 (+ 2982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:20.830532 (+ 1295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:20.830770 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:20.835262 (+ 4492us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:20.835274 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:20.835298 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:20.835347 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:20.839440 (+ 4093us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:20.840537 (+ 1097us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:20.840551 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:20.840559 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:20.840765 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:20.841325 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:20.841330 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:20.841334 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:20.842066 (+ 732us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:20.842262 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:20.846177 (+ 3915us) server_negotiation.cc:299] Negotiation successful
0619 06:41:20.846777 (+ 600us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6774,"thread_start_us":6565,"threads_started":1}
I20260619 06:41:20.852818 24110 heartbeater.cc:347] Connected to a master server at 127.10.192.126:32949
I20260619 06:41:20.853192 24110 heartbeater.cc:464] Registering TS with master...
I20260619 06:41:20.854120 24110 heartbeater.cc:511] Master 127.10.192.126:32949 requested a full tablet report, sending...
W20260619 06:41:20.857602 24110 heartbeater.cc:644] Failed to heartbeat to 127.10.192.126:32949 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260619 06:41:20.857862 24110 heartbeater.cc:464] Registering TS with master...
I20260619 06:41:20.858162 24110 heartbeater.cc:511] Master 127.10.192.126:32949 requested a full tablet report, sending...
I20260619 06:41:20.859457 24110 heartbeater.cc:464] Registering TS with master...
I20260619 06:41:20.859786 24110 heartbeater.cc:511] Master 127.10.192.126:32949 requested a full tablet report, sending...
W20260619 06:41:20.860944 24110 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260619 06:41:21.219547 24114 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:21.219995 24114 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:21.220170 24114 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:21.227816 24114 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:21.227974 24114 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:21.228149 24114 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:41:21.239320 24114 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:43743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.192.84:44941/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:38989
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=38025
--tserver_master_addrs=127.10.192.126:32949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:21.241341 24114 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:21.243177 24114 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:21.261874 24128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:21.269328 24131 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:21.269549 24129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:21.269994 24114 server_base.cc:1034] running on GCE node
I20260619 06:41:21.270744 24114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:21.271905 24114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:21.273175 24114 hybrid_clock.cc:648] HybridClock initialized: now 1781851281273097 us; error 65 us; skew 500 ppm
I20260619 06:41:21.273514 24114 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:21 dist-test-slave-7lz4 krb5kdc[22902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851281, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:21.276925 24114 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:41:21.278833 24114 webserver.cc:460] Webserver started at http://127.10.192.66:38025/ using document root <none> and password file <none>
I20260619 06:41:21.279862 24114 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:21.280028 24114 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 19 06:41:21 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851281, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
I20260619 06:41:21.331323 24114 fs_manager.cc:709] Time spent opening directory manager: real 0.028s user 0.008s sys 0.008s
I20260619 06:41:21.340571 24139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:21.348212 24114 fs_manager.cc:725] Time spent opening block manager: real 0.015s user 0.006s sys 0.003s
I20260619 06:41:21.348479 24114 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "5e7f6e467dfd43f988d8745a9159dd32"
format_stamp: "Formatted at 2026-06-19 06:41:18 on dist-test-slave-7lz4"
server_key: "0f4fc474b320c680149cf2b462929b14"
server_key_iv: "86d7f81dfdd8f001aebca2422245faa7"
server_key_version: "kuduclusterkey@0"
I20260619 06:41:21.349953 24114 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:21.368192 24114 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:21.374254 24114 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:21.374593 24114 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:21.409271 24114 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:41:21.416709 24114 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:41:21.416857 24114 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:21.416990 24114 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:41:21.417078 24114 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:21.476028 24114 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:38989
I20260619 06:41:21.476104 24253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:38989 every 8 connection(s)
I20260619 06:41:21.478039 24114 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:41:21.488423 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 24114
Jun 19 06:41:21 dist-test-slave-7lz4 krb5kdc[22902](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1781851281, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:21.489185 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.10.192.84:44941/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:38329
--local_ip_for_outbound_sockets=127.10.192.67
--tserver_master_addrs=127.10.192.126:32949
--webserver_port=44581
--webserver_interface=127.10.192.67
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:43743
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.10.192.84:44941/kms with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 06:41:21 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851281, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:21.528072 24257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:21.483219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:48279 (local address 127.10.192.126:32949)
0619 06:41:21.489428 (+ 6209us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:21.489435 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:21.489461 (+ 26us) server_negotiation.cc:407] Connection header received
0619 06:41:21.493983 (+ 4522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:21.493989 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:21.494089 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:21.494204 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:21.496585 (+ 2381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:21.497730 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:21.500288 (+ 2558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:21.501000 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:21.501104 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:21.510027 (+ 8923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:21.510036 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:21.510041 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:21.510091 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:21.513999 (+ 3908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:21.519286 (+ 5287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:21.519293 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:21.519297 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:21.519473 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:21.525447 (+ 5974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:21.525455 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:21.525459 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:21.525963 (+ 504us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:21.526149 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:21.527364 (+ 1215us) server_negotiation.cc:299] Negotiation successful
0619 06:41:21.527683 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6054,"thread_start_us":12434,"threads_started":1}
I20260619 06:41:21.530655 24256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:21.482604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:32949 (local address 127.10.192.66:48279)
0619 06:41:21.484992 (+ 2388us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:21.485055 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:21.487464 (+ 2409us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:21.494731 (+ 7267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:21.494745 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:21.495420 (+ 675us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:21.496338 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:21.496365 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:21.497948 (+ 1583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:21.497954 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:21.500103 (+ 2149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:21.500121 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:21.501496 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:21.501503 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:21.501819 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:21.506817 (+ 4998us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:21.506861 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:21.509655 (+ 2794us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:21.518345 (+ 8690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:21.518357 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:21.518381 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:21.519080 (+ 699us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:21.519677 (+ 597us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:21.519682 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:21.519686 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:21.519977 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:21.526283 (+ 6306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:21.526293 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:21.526855 (+ 562us) client_negotiation.cc:769] Sending connection context
0619 06:41:21.528350 (+ 1495us) client_negotiation.cc:240] Negotiation successful
0619 06:41:21.529010 (+ 660us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2063,"thread_start_us":1831,"threads_started":1}
I20260619 06:41:21.532500 24254 heartbeater.cc:347] Connected to a master server at 127.10.192.126:32949
I20260619 06:41:21.532851 24254 heartbeater.cc:464] Registering TS with master...
I20260619 06:41:21.533623 24254 heartbeater.cc:511] Master 127.10.192.126:32949 requested a full tablet report, sending...
I20260619 06:41:21.535472 23913 ts_manager.cc:194] Registered new tserver with Master: 5e7f6e467dfd43f988d8745a9159dd32 (127.10.192.66:38989)
I20260619 06:41:21.537096 23913 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:48279
I20260619 06:41:21.861093 24110 heartbeater.cc:464] Registering TS with master...
I20260619 06:41:21.861542 24110 heartbeater.cc:511] Master 127.10.192.126:32949 requested a full tablet report, sending...
I20260619 06:41:21.862854 23913 ts_manager.cc:194] Registered new tserver with Master: d492861751d942c5bbbfc01046cd1fb8 (127.10.192.65:40651)
I20260619 06:41:21.864195 23913 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:35829
W20260619 06:41:21.909811 24258 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:21.910218 24258 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:21.910413 24258 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:21.921967 24258 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:21.922205 24258 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:21.922442 24258 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
Jun 19 06:41:21 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851281, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
I20260619 06:41:21.938163 24258 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:43743
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.10.192.84:44941/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:38329
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=44581
--tserver_master_addrs=127.10.192.126:32949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:21.940044 24258 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:21.941936 24258 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:22.000770 24264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:22.005666 24265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:22.007364 24268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:22.008494 24258 server_base.cc:1034] running on GCE node
I20260619 06:41:22.009337 24258 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:22.010600 24258 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:22.011906 24258 hybrid_clock.cc:648] HybridClock initialized: now 1781851282011838 us; error 56 us; skew 500 ppm
I20260619 06:41:22.012292 24258 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:22 dist-test-slave-7lz4 krb5kdc[22902](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851282, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:22.016566 24258 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:41:22.018589 24258 webserver.cc:460] Webserver started at http://127.10.192.67:44581/ using document root <none> and password file <none>
I20260619 06:41:22.019484 24258 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:22.019660 24258 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Jun 19 06:41:22 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851282, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
I20260619 06:41:22.042925 24258 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 06:41:22.046634 24275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:22.048511 24258 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260619 06:41:22.048689 24258 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "da7e6b3d1f2b424590aff07db713104c"
format_stamp: "Formatted at 2026-06-19 06:41:18 on dist-test-slave-7lz4"
server_key: "0437da40f702ec6d18d2a31a52e459a7"
server_key_iv: "5452dea75084a3c9b772a6049df8c669"
server_key_version: "kuduclusterkey@0"
I20260619 06:41:22.050073 24258 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:22.102671 24258 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:22.108107 24258 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:22.108458 24258 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:22.109726 24258 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:41:22.111466 24258 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:41:22.111615 24258 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:22.111801 24258 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:41:22.111912 24258 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:22.156937 24258 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:38329
I20260619 06:41:22.157023 24387 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:38329 every 8 connection(s)
I20260619 06:41:22.158859 24258 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:41:22.162949 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 24258
Jun 19 06:41:22 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851282, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:22.190973 24391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:22.163311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:51731 (local address 127.10.192.126:32949)
0619 06:41:22.164388 (+ 1077us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:22.164396 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:22.167680 (+ 3284us) server_negotiation.cc:407] Connection header received
0619 06:41:22.170862 (+ 3182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:22.170867 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:22.170949 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:22.171024 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:22.173406 (+ 2382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.174669 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.177076 (+ 2407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.177783 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.177907 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:22.182869 (+ 4962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:22.182878 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:22.182883 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:22.182954 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:22.186871 (+ 3917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:22.187946 (+ 1075us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:22.187953 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:22.187957 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:22.188170 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:22.188798 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:22.188803 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:22.188806 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:22.189146 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:22.189272 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:22.190321 (+ 1049us) server_negotiation.cc:299] Negotiation successful
0619 06:41:22.190560 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":942,"thread_start_us":1055,"threads_started":1}
I20260619 06:41:22.192039 24393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:22.164267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43474 (local address 127.10.192.126:32949)
0619 06:41:22.164695 (+ 428us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:22.164700 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:22.168318 (+ 3618us) server_negotiation.cc:407] Connection header received
0619 06:41:22.170311 (+ 1993us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:22.170318 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:22.170434 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:22.170550 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:22.172846 (+ 2296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.174276 (+ 1430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.176443 (+ 2167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.177115 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.177241 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:22.182400 (+ 5159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:22.182408 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:22.182412 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:22.182453 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:22.187142 (+ 4689us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:22.188004 (+ 862us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:22.188009 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:22.188012 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:22.188225 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:22.188655 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:22.188660 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:22.188663 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:22.188986 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:22.189229 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:22.190392 (+ 1163us) server_negotiation.cc:299] Negotiation successful
0619 06:41:22.191662 (+ 1270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1014,"server-negotiator.queue_time_us":341,"spinlock_wait_cycles":2432,"thread_start_us":237,"threads_started":1}
I20260619 06:41:22.196383 24390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:22.162689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:32949 (local address 127.10.192.67:51731)
0619 06:41:22.165686 (+ 2997us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:22.165734 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:22.170528 (+ 4794us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:22.171667 (+ 1139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:22.171680 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:22.172301 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:22.173163 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:22.173189 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.174880 (+ 1691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.174885 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:22.176906 (+ 2021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:22.176920 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.178250 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.178258 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:22.178555 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:22.179290 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:22.179319 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:22.182523 (+ 3204us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:22.187082 (+ 4559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:22.187091 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:22.187111 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:22.187796 (+ 685us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:22.188336 (+ 540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:22.188343 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:22.188350 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:22.188665 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:22.189372 (+ 707us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:22.189380 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:22.189848 (+ 468us) client_negotiation.cc:769] Sending connection context
0619 06:41:22.193088 (+ 3240us) client_negotiation.cc:240] Negotiation successful
0619 06:41:22.194910 (+ 1822us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2698,"thread_start_us":2496,"threads_started":1}
I20260619 06:41:22.198262 24388 heartbeater.cc:347] Connected to a master server at 127.10.192.126:32949
I20260619 06:41:22.198571 24388 heartbeater.cc:464] Registering TS with master...
I20260619 06:41:22.199462 24388 heartbeater.cc:511] Master 127.10.192.126:32949 requested a full tablet report, sending...
I20260619 06:41:22.201172 23913 ts_manager.cc:194] Registered new tserver with Master: da7e6b3d1f2b424590aff07db713104c (127.10.192.67:38329)
I20260619 06:41:22.202307 23913 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:51731
I20260619 06:41:22.207440 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Jun 19 06:41:22 dist-test-slave-7lz4 krb5kdc[22902](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851281, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for HTTP/127.10.192.84@KRBTEST.COM
I20260619 06:41:22.233464 24393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:22.211270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43482 (local address 127.10.192.126:32949)
0619 06:41:22.211471 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:22.211477 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:22.216213 (+ 4736us) server_negotiation.cc:407] Connection header received
0619 06:41:22.216363 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:22.216368 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:22.216472 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:22.216585 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:22.218857 (+ 2272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.220012 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.221933 (+ 1921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.222578 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.222701 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:22.227402 (+ 4701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:22.227408 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:22.227411 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:22.227448 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:22.230163 (+ 2715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:22.230968 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:22.230974 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:22.230978 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:22.231158 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:22.231675 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:22.231680 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:22.231683 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:22.232048 (+ 365us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:22.232293 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:22.232890 (+ 597us) server_negotiation.cc:299] Negotiation successful
0619 06:41:22.233129 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 06:41:22.239193 23913 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43482:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:41:22.250650 23913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:41:22.368623 24407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:22.312813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43108 (local address 127.10.192.65:40651)
0619 06:41:22.331848 (+ 19035us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:22.331862 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:22.348575 (+ 16713us) server_negotiation.cc:407] Connection header received
0619 06:41:22.348798 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:22.348807 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:22.349027 (+ 220us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:22.349213 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:22.350655 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.352317 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.361083 (+ 8766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.362686 (+ 1603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.362811 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:22.363078 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:22.368037 (+ 4959us) server_negotiation.cc:299] Negotiation successful
0619 06:41:22.368267 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18821,"thread_start_us":18639,"threads_started":1}
I20260619 06:41:22.369899 24409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:22.312433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:40651 (local address 127.0.0.1:43108)
0619 06:41:22.348436 (+ 36003us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:22.348459 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:22.348600 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:22.349534 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:22.349539 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:22.349589 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:22.350457 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:22.350469 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.352511 (+ 2042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.352517 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:22.354843 (+ 2326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:22.354859 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.363315 (+ 8456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.363322 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:22.363552 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:22.363610 (+ 58us) client_negotiation.cc:769] Sending connection context
0619 06:41:22.369228 (+ 5618us) client_negotiation.cc:240] Negotiation successful
0619 06:41:22.369476 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35882,"spinlock_wait_cycles":11008,"thread_start_us":25227,"threads_started":1}
I20260619 06:41:22.374787 24045 tablet_service.cc:1467] Processing CreateTablet for tablet ae34be93aabb47c59056bf734d62ca57 (DEFAULT_TABLE table=test-table [id=2de23d627fb445c183d8870b14d37c03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:41:22.376458 24045 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae34be93aabb47c59056bf734d62ca57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:41:22.377239 24404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:22.345718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:38989 (local address 127.0.0.1:44434)
0619 06:41:22.349250 (+ 3532us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:22.349266 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:22.355199 (+ 5933us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:22.356213 (+ 1014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:22.356218 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:22.356323 (+ 105us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:22.356645 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:22.356657 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.365713 (+ 9056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.365718 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:22.367794 (+ 2076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:22.367811 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.376429 (+ 8618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.376435 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:22.376603 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:22.376637 (+ 34us) client_negotiation.cc:769] Sending connection context
0619 06:41:22.376716 (+ 79us) client_negotiation.cc:240] Negotiation successful
0619 06:41:22.376868 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3423,"thread_start_us":24524,"threads_started":1}
I20260619 06:41:22.378104 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:22.338881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44434 (local address 127.10.192.66:38989)
0619 06:41:22.348042 (+ 9161us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:22.348053 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:22.349367 (+ 1314us) server_negotiation.cc:407] Connection header received
0619 06:41:22.355433 (+ 6066us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:22.355442 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:22.355718 (+ 276us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:22.355892 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:22.363874 (+ 7982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.365508 (+ 1634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.374415 (+ 8907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.375907 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.376021 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:22.376226 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:22.377570 (+ 1344us) server_negotiation.cc:299] Negotiation successful
0619 06:41:22.377743 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8980,"thread_start_us":8976,"threads_started":1}
I20260619 06:41:22.379168 24405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:22.312247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55034 (local address 127.10.192.67:38329)
0619 06:41:22.332429 (+ 20182us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:22.332437 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:22.337624 (+ 5187us) server_negotiation.cc:407] Connection header received
0619 06:41:22.348277 (+ 10653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:22.348288 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:22.348600 (+ 312us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:22.348788 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:22.356872 (+ 8084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.358565 (+ 1693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.371772 (+ 13207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.373401 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.373524 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:22.373753 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:22.378611 (+ 4858us) server_negotiation.cc:299] Negotiation successful
0619 06:41:22.378803 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20029,"thread_start_us":19883,"threads_started":1}
I20260619 06:41:22.380157 24406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:22.311966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:38329 (local address 127.0.0.1:55034)
0619 06:41:22.337416 (+ 25450us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:22.337480 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:22.346718 (+ 9238us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:22.349527 (+ 2809us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:22.349534 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:22.349577 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:22.349958 (+ 381us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:22.349972 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.358754 (+ 8782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.358759 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:22.360863 (+ 2104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:22.360880 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.373958 (+ 13078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.373963 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:22.374203 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:22.374238 (+ 35us) client_negotiation.cc:769] Sending connection context
0619 06:41:22.379579 (+ 5341us) client_negotiation.cc:240] Negotiation successful
0619 06:41:22.379759 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25130,"spinlock_wait_cycles":2816,"thread_start_us":35681,"threads_started":1}
I20260619 06:41:22.383893 24189 tablet_service.cc:1467] Processing CreateTablet for tablet ae34be93aabb47c59056bf734d62ca57 (DEFAULT_TABLE table=test-table [id=2de23d627fb445c183d8870b14d37c03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:41:22.384979 24323 tablet_service.cc:1467] Processing CreateTablet for tablet ae34be93aabb47c59056bf734d62ca57 (DEFAULT_TABLE table=test-table [id=2de23d627fb445c183d8870b14d37c03]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:41:22.386951 24189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae34be93aabb47c59056bf734d62ca57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:41:22.387882 24323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ae34be93aabb47c59056bf734d62ca57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:41:22.432755 24410 tablet_bootstrap.cc:492] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32: Bootstrap starting.
I20260619 06:41:22.436362 24411 tablet_bootstrap.cc:492] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8: Bootstrap starting.
I20260619 06:41:22.443372 24410 tablet_bootstrap.cc:654] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32: Neither blocks nor log segments found. Creating new log.
I20260619 06:41:22.444969 24410 log.cc:824] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:22.448614 24411 tablet_bootstrap.cc:654] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8: Neither blocks nor log segments found. Creating new log.
I20260619 06:41:22.449616 24412 tablet_bootstrap.cc:492] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c: Bootstrap starting.
I20260619 06:41:22.451166 24411 log.cc:824] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:22.456284 24412 tablet_bootstrap.cc:654] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c: Neither blocks nor log segments found. Creating new log.
I20260619 06:41:22.457855 24412 log.cc:824] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:22.462385 24410 tablet_bootstrap.cc:492] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32: No bootstrap required, opened a new log
I20260619 06:41:22.462795 24410 ts_tablet_manager.cc:1397] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32: Time spent bootstrapping tablet: real 0.030s user 0.014s sys 0.003s
I20260619 06:41:22.470842 24411 tablet_bootstrap.cc:492] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8: No bootstrap required, opened a new log
I20260619 06:41:22.471287 24411 ts_tablet_manager.cc:1397] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8: Time spent bootstrapping tablet: real 0.035s user 0.010s sys 0.000s
I20260619 06:41:22.494652 24410 raft_consensus.cc:348] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d492861751d942c5bbbfc01046cd1fb8" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 40651 } } peers { permanent_uuid: "da7e6b3d1f2b424590aff07db713104c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38329 } } peers { permanent_uuid: "5e7f6e467dfd43f988d8745a9159dd32" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38989 } }
I20260619 06:41:22.500854 24411 raft_consensus.cc:348] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d492861751d942c5bbbfc01046cd1fb8" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 40651 } } peers { permanent_uuid: "da7e6b3d1f2b424590aff07db713104c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38329 } } peers { permanent_uuid: "5e7f6e467dfd43f988d8745a9159dd32" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38989 } }
I20260619 06:41:22.501674 24410 raft_consensus.cc:374] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:41:22.505128 24410 raft_consensus.cc:729] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e7f6e467dfd43f988d8745a9159dd32, State: Initialized, Role: FOLLOWER
I20260619 06:41:22.506835 24410 consensus_queue.cc:260] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d492861751d942c5bbbfc01046cd1fb8" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 40651 } } peers { permanent_uuid: "da7e6b3d1f2b424590aff07db713104c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38329 } } peers { permanent_uuid: "5e7f6e467dfd43f988d8745a9159dd32" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38989 } }
I20260619 06:41:22.507428 24411 raft_consensus.cc:374] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:41:22.509737 24412 tablet_bootstrap.cc:492] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c: No bootstrap required, opened a new log
I20260619 06:41:22.510037 24412 ts_tablet_manager.cc:1397] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c: Time spent bootstrapping tablet: real 0.061s user 0.007s sys 0.019s
I20260619 06:41:22.519810 24411 raft_consensus.cc:729] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d492861751d942c5bbbfc01046cd1fb8, State: Initialized, Role: FOLLOWER
I20260619 06:41:22.521215 24411 consensus_queue.cc:260] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d492861751d942c5bbbfc01046cd1fb8" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 40651 } } peers { permanent_uuid: "da7e6b3d1f2b424590aff07db713104c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38329 } } peers { permanent_uuid: "5e7f6e467dfd43f988d8745a9159dd32" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38989 } }
I20260619 06:41:22.521471 24254 heartbeater.cc:503] Master 127.10.192.126:32949 was elected leader, sending a full tablet report...
I20260619 06:41:22.522387 24110 heartbeater.cc:503] Master 127.10.192.126:32949 was elected leader, sending a full tablet report...
I20260619 06:41:22.523005 24410 ts_tablet_manager.cc:1428] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32: Time spent starting tablet: real 0.060s user 0.012s sys 0.001s
I20260619 06:41:22.524343 24412 raft_consensus.cc:348] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d492861751d942c5bbbfc01046cd1fb8" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 40651 } } peers { permanent_uuid: "da7e6b3d1f2b424590aff07db713104c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38329 } } peers { permanent_uuid: "5e7f6e467dfd43f988d8745a9159dd32" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38989 } }
I20260619 06:41:22.524811 24412 raft_consensus.cc:374] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:41:22.524899 24412 raft_consensus.cc:729] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da7e6b3d1f2b424590aff07db713104c, State: Initialized, Role: FOLLOWER
I20260619 06:41:22.525496 24412 consensus_queue.cc:260] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d492861751d942c5bbbfc01046cd1fb8" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 40651 } } peers { permanent_uuid: "da7e6b3d1f2b424590aff07db713104c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38329 } } peers { permanent_uuid: "5e7f6e467dfd43f988d8745a9159dd32" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38989 } }
I20260619 06:41:22.527035 24411 ts_tablet_manager.cc:1428] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8: Time spent starting tablet: real 0.056s user 0.005s sys 0.008s
I20260619 06:41:22.536716 24388 heartbeater.cc:503] Master 127.10.192.126:32949 was elected leader, sending a full tablet report...
I20260619 06:41:22.537513 24412 ts_tablet_manager.cc:1428] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c: Time spent starting tablet: real 0.027s user 0.019s sys 0.003s
W20260619 06:41:22.559543 24111 tablet.cc:2369] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:41:22.614389 24418 raft_consensus.cc:482] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:41:22.614748 24418 raft_consensus.cc:504] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d492861751d942c5bbbfc01046cd1fb8" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 40651 } } peers { permanent_uuid: "da7e6b3d1f2b424590aff07db713104c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38329 } } peers { permanent_uuid: "5e7f6e467dfd43f988d8745a9159dd32" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38989 } }
I20260619 06:41:22.616650 24418 leader_election.cc:288] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da7e6b3d1f2b424590aff07db713104c (127.10.192.67:38329), 5e7f6e467dfd43f988d8745a9159dd32 (127.10.192.66:38989)
I20260619 06:41:22.624444 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:22.617595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:47343 (local address 127.10.192.66:38989)
0619 06:41:22.617824 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:22.617830 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:22.618525 (+ 695us) server_negotiation.cc:407] Connection header received
0619 06:41:22.618758 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:22.618765 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:22.618843 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:22.618934 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:22.619590 (+ 656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.620641 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.622533 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.623449 (+ 916us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.623615 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:22.623728 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:22.624040 (+ 312us) server_negotiation.cc:299] Negotiation successful
0619 06:41:22.624174 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260619 06:41:22.624514 24427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:22.617211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:38989 (local address 127.10.192.65:47343)
0619 06:41:22.618437 (+ 1226us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:22.618454 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:22.618608 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:22.618974 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:22.618979 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:22.619009 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:22.619424 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:22.619437 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.620774 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.620779 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:22.622381 (+ 1602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:22.622395 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.623684 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.623691 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:22.623861 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:22.623896 (+ 35us) client_negotiation.cc:769] Sending connection context
0619 06:41:22.624000 (+ 104us) client_negotiation.cc:240] Negotiation successful
0619 06:41:22.624131 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1117,"mutex_wait_us":44,"thread_start_us":934,"threads_started":1}
I20260619 06:41:22.625476 24405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:22.617303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:36265 (local address 127.10.192.67:38329)
0619 06:41:22.617545 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:22.617555 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:22.618271 (+ 716us) server_negotiation.cc:407] Connection header received
0619 06:41:22.618580 (+ 309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:22.618586 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:22.618666 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:22.618781 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:22.619433 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.620567 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.623231 (+ 2664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.624342 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.624498 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:22.624583 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:22.625103 (+ 520us) server_negotiation.cc:299] Negotiation successful
0619 06:41:22.625235 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260619 06:41:22.625572 24426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:22.617040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:38329 (local address 127.10.192.65:36265)
0619 06:41:22.618113 (+ 1073us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:22.618144 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:22.618394 (+ 250us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:22.618789 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:22.618793 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:22.618814 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:22.619282 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:22.619294 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.620745 (+ 1451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.620750 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:22.623055 (+ 2305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:22.623070 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.624747 (+ 1677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.624753 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:22.624927 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:22.624957 (+ 30us) client_negotiation.cc:769] Sending connection context
0619 06:41:22.625076 (+ 119us) client_negotiation.cc:240] Negotiation successful
0619 06:41:22.625210 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":920,"mutex_wait_us":29,"thread_start_us":674,"threads_started":1}
I20260619 06:41:22.625774 24209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae34be93aabb47c59056bf734d62ca57" candidate_uuid: "d492861751d942c5bbbfc01046cd1fb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7f6e467dfd43f988d8745a9159dd32" is_pre_election: true
I20260619 06:41:22.626353 24209 raft_consensus.cc:2454] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d492861751d942c5bbbfc01046cd1fb8 in term 0.
I20260619 06:41:22.626536 24343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae34be93aabb47c59056bf734d62ca57" candidate_uuid: "d492861751d942c5bbbfc01046cd1fb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da7e6b3d1f2b424590aff07db713104c" is_pre_election: true
I20260619 06:41:22.627064 24343 raft_consensus.cc:2454] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d492861751d942c5bbbfc01046cd1fb8 in term 0.
I20260619 06:41:22.627089 24000 leader_election.cc:302] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7f6e467dfd43f988d8745a9159dd32, d492861751d942c5bbbfc01046cd1fb8; no voters:
I20260619 06:41:22.627532 24418 raft_consensus.cc:2781] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:41:22.627705 24418 raft_consensus.cc:482] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:41:22.627815 24418 raft_consensus.cc:3037] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:41:22.631013 24418 raft_consensus.cc:504] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d492861751d942c5bbbfc01046cd1fb8" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 40651 } } peers { permanent_uuid: "da7e6b3d1f2b424590aff07db713104c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38329 } } peers { permanent_uuid: "5e7f6e467dfd43f988d8745a9159dd32" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38989 } }
I20260619 06:41:22.631796 24418 leader_election.cc:288] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [CANDIDATE]: Term 1 election: Requested vote from peers da7e6b3d1f2b424590aff07db713104c (127.10.192.67:38329), 5e7f6e467dfd43f988d8745a9159dd32 (127.10.192.66:38989)
I20260619 06:41:22.632349 24343 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae34be93aabb47c59056bf734d62ca57" candidate_uuid: "d492861751d942c5bbbfc01046cd1fb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da7e6b3d1f2b424590aff07db713104c"
I20260619 06:41:22.632318 24209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ae34be93aabb47c59056bf734d62ca57" candidate_uuid: "d492861751d942c5bbbfc01046cd1fb8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e7f6e467dfd43f988d8745a9159dd32"
I20260619 06:41:22.632561 24343 raft_consensus.cc:3037] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:41:22.632596 24209 raft_consensus.cc:3037] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:41:22.634976 24209 raft_consensus.cc:2454] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d492861751d942c5bbbfc01046cd1fb8 in term 1.
I20260619 06:41:22.635437 24000 leader_election.cc:302] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5e7f6e467dfd43f988d8745a9159dd32, d492861751d942c5bbbfc01046cd1fb8; no voters:
I20260619 06:41:22.635620 24343 raft_consensus.cc:2454] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d492861751d942c5bbbfc01046cd1fb8 in term 1.
I20260619 06:41:22.635758 24418 raft_consensus.cc:2781] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:41:22.636410 24418 raft_consensus.cc:686] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [term 1 LEADER]: Becoming Leader. State: Replica: d492861751d942c5bbbfc01046cd1fb8, State: Running, Role: LEADER
I20260619 06:41:22.636971 24418 consensus_queue.cc:237] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d492861751d942c5bbbfc01046cd1fb8" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 40651 } } peers { permanent_uuid: "da7e6b3d1f2b424590aff07db713104c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38329 } } peers { permanent_uuid: "5e7f6e467dfd43f988d8745a9159dd32" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38989 } }
I20260619 06:41:22.642061 23912 catalog_manager.cc:5495] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 reported cstate change: term changed from 0 to 1, leader changed from <none> to d492861751d942c5bbbfc01046cd1fb8 (127.10.192.65). New cstate: current_term: 1 leader_uuid: "d492861751d942c5bbbfc01046cd1fb8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d492861751d942c5bbbfc01046cd1fb8" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 40651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da7e6b3d1f2b424590aff07db713104c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5e7f6e467dfd43f988d8745a9159dd32" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38989 } health_report { overall_health: UNKNOWN } } }
W20260619 06:41:22.670295 24389 tablet.cc:2369] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:41:22.686494 24407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:22.680746 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43122 (local address 127.10.192.65:40651)
0619 06:41:22.680961 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:22.680969 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:22.680995 (+ 26us) server_negotiation.cc:407] Connection header received
0619 06:41:22.681326 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:22.681334 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:22.681444 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:22.681598 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:41:22.681951 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.682720 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.684312 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.684724 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.684863 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:22.685389 (+ 526us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:41:22.685913 (+ 524us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:41:22.686075 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:22.686132 (+ 57us) server_negotiation.cc:299] Negotiation successful
0619 06:41:22.686213 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260619 06:41:22.694972 24209 raft_consensus.cc:1261] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32 [term 1 FOLLOWER]: Refusing update from remote peer d492861751d942c5bbbfc01046cd1fb8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:41:22.695056 24343 raft_consensus.cc:1261] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c [term 1 FOLLOWER]: Refusing update from remote peer d492861751d942c5bbbfc01046cd1fb8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:41:22.696009 24428 consensus_queue.cc:1035] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e7f6e467dfd43f988d8745a9159dd32" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:41:22.696384 24418 consensus_queue.cc:1035] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da7e6b3d1f2b424590aff07db713104c" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:41:22.722291 24431 mvcc.cc:205] Tried to move back new op lower bound from 7298462853908520960 to 7298462853685313536. Current Snapshot: MvccSnapshot[applied={T|T < 7298462853908520960}]
I20260619 06:41:22.725946 24432 mvcc.cc:205] Tried to move back new op lower bound from 7298462853908520960 to 7298462853685313536. Current Snapshot: MvccSnapshot[applied={T|T < 7298462853908520960}]
I20260619 06:41:22.727767 24433 mvcc.cc:205] Tried to move back new op lower bound from 7298462853908520960 to 7298462853685313536. Current Snapshot: MvccSnapshot[applied={T|T < 7298462853908520960}]
I20260619 06:41:22.745612 23912 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:41:22.745927 23912 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43482:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:41:22.750114 23912 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 74a1c3fc9b1d40c092814767a03037b5: Sending DeleteTablet for 3 replicas of tablet ae34be93aabb47c59056bf734d62ca57
I20260619 06:41:22.751453 24323 tablet_service.cc:1514] Processing DeleteTablet for tablet ae34be93aabb47c59056bf734d62ca57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:41:22 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:55034
I20260619 06:41:22.751910 24189 tablet_service.cc:1514] Processing DeleteTablet for tablet ae34be93aabb47c59056bf734d62ca57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:41:22 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:44434
I20260619 06:41:22.752219 24045 tablet_service.cc:1514] Processing DeleteTablet for tablet ae34be93aabb47c59056bf734d62ca57 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:41:22 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:43108
I20260619 06:41:22.756188 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 23950
I20260619 06:41:22.761641 24443 tablet_replica.cc:330] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8: stopping tablet replica
I20260619 06:41:22.762264 24443 raft_consensus.cc:2229] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:41:22.763209 24443 raft_consensus.cc:2258] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:41:22.765641 24441 tablet_replica.cc:330] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c: stopping tablet replica
I20260619 06:41:22.766201 24441 raft_consensus.cc:2229] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:41:22.766821 24441 raft_consensus.cc:2258] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:41:22.768086 24442 tablet_replica.cc:330] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32: stopping tablet replica
I20260619 06:41:22.768554 24442 raft_consensus.cc:2229] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:41:22.769125 24442 raft_consensus.cc:2258] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:41:22.769676 24443 ts_tablet_manager.cc:1905] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:41:22.771219 24442 ts_tablet_manager.cc:1905] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:41:22.776517 24441 ts_tablet_manager.cc:1905] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:41:22.777671 24443 ts_tablet_manager.cc:1918] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:41:22.777948 24443 log.cc:1196] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/ae34be93aabb47c59056bf734d62ca57
I20260619 06:41:22.781066 24443 ts_tablet_manager.cc:1939] T ae34be93aabb47c59056bf734d62ca57 P d492861751d942c5bbbfc01046cd1fb8: Deleting consensus metadata
I20260619 06:41:22.782066 24442 ts_tablet_manager.cc:1918] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:41:22.782341 24442 log.cc:1196] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/ae34be93aabb47c59056bf734d62ca57
I20260619 06:41:22.782948 24442 ts_tablet_manager.cc:1939] T ae34be93aabb47c59056bf734d62ca57 P 5e7f6e467dfd43f988d8745a9159dd32: Deleting consensus metadata
I20260619 06:41:22.783250 23900 catalog_manager.cc:4841] TS d492861751d942c5bbbfc01046cd1fb8 (127.10.192.65:40651): tablet ae34be93aabb47c59056bf734d62ca57 (table test-table [id=2de23d627fb445c183d8870b14d37c03]) successfully deleted
I20260619 06:41:22.784091 24441 ts_tablet_manager.cc:1918] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:41:22.784297 24441 log.cc:1196] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/ae34be93aabb47c59056bf734d62ca57
I20260619 06:41:22.784406 24407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:22.757474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43130 (local address 127.10.192.65:40651)
0619 06:41:22.757647 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:22.757654 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:22.761049 (+ 3395us) server_negotiation.cc:407] Connection header received
0619 06:41:22.761566 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:22.761573 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:22.761690 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:22.761768 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:22.763739 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.764994 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.766982 (+ 1988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.767726 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.767834 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:22.771656 (+ 3822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:22.771672 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:22.771694 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:22.771751 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:22.776276 (+ 4525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:22.777367 (+ 1091us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:22.777377 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:22.777381 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:22.777632 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:22.778282 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:22.778289 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:22.778292 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:22.780231 (+ 1939us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:22.780586 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:22.783755 (+ 3169us) server_negotiation.cc:299] Negotiation successful
0619 06:41:22.784020 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260619 06:41:22.784884 24441 ts_tablet_manager.cc:1939] T ae34be93aabb47c59056bf734d62ca57 P da7e6b3d1f2b424590aff07db713104c: Deleting consensus metadata
I20260619 06:41:22.785219 24105 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:22.785277 23900 catalog_manager.cc:4841] TS 5e7f6e467dfd43f988d8745a9159dd32 (127.10.192.66:38989): tablet ae34be93aabb47c59056bf734d62ca57 (table test-table [id=2de23d627fb445c183d8870b14d37c03]) successfully deleted
I20260619 06:41:22.786419 23899 catalog_manager.cc:4841] TS da7e6b3d1f2b424590aff07db713104c (127.10.192.67:38329): tablet ae34be93aabb47c59056bf734d62ca57 (table test-table [id=2de23d627fb445c183d8870b14d37c03]) successfully deleted
I20260619 06:41:22.884303 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 23950
I20260619 06:41:22.902300 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 24114
I20260619 06:41:22.915854 24408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:22.903077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44446 (local address 127.10.192.66:38989)
0619 06:41:22.903319 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:22.903323 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:22.903341 (+ 18us) server_negotiation.cc:407] Connection header received
0619 06:41:22.903483 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:22.903487 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:22.903557 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:22.903696 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:22.905091 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.905860 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.907099 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:22.907495 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:22.907586 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:22.910096 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:22.910111 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:22.910127 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:22.910161 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:22.913192 (+ 3031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:22.913855 (+ 663us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:22.913862 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:22.913864 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:22.913991 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:22.914317 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:22.914320 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:22.914322 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:22.914699 (+ 377us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:22.914904 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:22.915141 (+ 237us) server_negotiation.cc:299] Negotiation successful
0619 06:41:22.915340 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260619 06:41:22.916577 24249 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:23.005400 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 24114
I20260619 06:41:23.021739 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 24258
I20260619 06:41:23.034977 24405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:23.022587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55044 (local address 127.10.192.67:38329)
0619 06:41:23.022764 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:23.022769 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:23.022788 (+ 19us) server_negotiation.cc:407] Connection header received
0619 06:41:23.022895 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:23.022899 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:23.022960 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:23.023043 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:23.024350 (+ 1307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:23.025093 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:23.026359 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:23.026728 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:23.026815 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:23.029620 (+ 2805us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:23.029633 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:23.029648 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:23.029693 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:23.032395 (+ 2702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:23.033034 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:23.033041 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:23.033043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:23.033156 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:23.033464 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:23.033467 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:23.033469 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:23.033813 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:23.034099 (+ 286us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:23.034411 (+ 312us) server_negotiation.cc:299] Negotiation successful
0619 06:41:23.034601 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 06:41:23.035830 24383 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:23.125321 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 24258
I20260619 06:41:23.141471 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 23880
I20260619 06:41:23.142702 23943 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:23.256680 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 23880
I20260619 06:41:23.279276 11009 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260619 06:41:23.615548 11009 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260619 06:41:23.615823 11009 mini_ranger.cc:66] Stopping Ranger...
I20260619 06:41:23.962108 11009 mini_ranger.cc:68] Stopped Ranger
2026-06-19 06:41:23.962 UTC [22932] LOG: received smart shutdown request
2026-06-19 06:41:23.965 UTC [22932] LOG: background worker "logical replication launcher" (PID 22941) exited with exit code 1
2026-06-19 06:41:23.966 UTC [22936] LOG: shutting down
2026-06-19 06:41:24.125 UTC [22932] LOG: database system is shut down
2026-06-19T06:41:24Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (52548 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:41:24 dist-test-slave-7lz4 krb5kdc[24457](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:41:24 dist-test-slave-7lz4 krb5kdc[24457](info): set up 2 sockets
Jun 19 06:41:24 dist-test-slave-7lz4 krb5kdc[24457](info): commencing operation
krb5kdc: starting...
W20260619 06:41:25.368041 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.000s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:41:25 dist-test-slave-7lz4 krb5kdc[24457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:41:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:41:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:41:25.604700 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:43363
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:46857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:43363,127.10.192.125:33003,127.10.192.124:41639
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:41:25.935395 24470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:25.935823 24470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:25.935920 24470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:25.943161 24470 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:41:25.943271 24470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:25.943320 24470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:25.943370 24470 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:41:25.943414 24470 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:41:25.953402 24470 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:46857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:43363,127.10.192.125:33003,127.10.192.124:41639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:43363
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:25.954720 24470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:25.956132 24470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:25.968097 24475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:25.968130 24476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:25.968101 24478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:25.969136 24470 server_base.cc:1034] running on GCE node
I20260619 06:41:25.969902 24470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:25.971266 24470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:25.972565 24470 hybrid_clock.cc:648] HybridClock initialized: now 1781851285972511 us; error 38 us; skew 500 ppm
I20260619 06:41:25.972913 24470 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:25 dist-test-slave-7lz4 krb5kdc[24457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851285, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:25.976351 24470 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:41:25.977965 24470 webserver.cc:460] Webserver started at http://127.10.192.126:40265/ using document root <none> and password file <none>
I20260619 06:41:25.978703 24470 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:25.978837 24470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:25.979153 24470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:41:25.982247 24470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "96a7463fe0df46ea8b4c6c750b7e79c8"
format_stamp: "Formatted at 2026-06-19 06:41:25 on dist-test-slave-7lz4"
server_key: "32d1791607b47efdc1814c8dce1e22e6"
server_key_iv: "c90a0963f30244a3691aaa3425c1a583"
server_key_version: "encryptionkey@0"
I20260619 06:41:25.983151 24470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "96a7463fe0df46ea8b4c6c750b7e79c8"
format_stamp: "Formatted at 2026-06-19 06:41:25 on dist-test-slave-7lz4"
server_key: "32d1791607b47efdc1814c8dce1e22e6"
server_key_iv: "c90a0963f30244a3691aaa3425c1a583"
server_key_version: "encryptionkey@0"
I20260619 06:41:25.988583 24470 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260619 06:41:25.992055 24485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:25.993588 24470 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:41:25.993778 24470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "96a7463fe0df46ea8b4c6c750b7e79c8"
format_stamp: "Formatted at 2026-06-19 06:41:25 on dist-test-slave-7lz4"
server_key: "32d1791607b47efdc1814c8dce1e22e6"
server_key_iv: "c90a0963f30244a3691aaa3425c1a583"
server_key_version: "encryptionkey@0"
I20260619 06:41:25.993981 24470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:26.010140 24470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:26.014415 24470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:26.014725 24470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:26.033840 24470 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:43363
I20260619 06:41:26.033874 24536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:43363 every 8 connection(s)
I20260619 06:41:26.035265 24470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:41:26.037626 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 24470
I20260619 06:41:26.037878 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:41:26.038502 11009 external_mini_cluster.cc:1428] Setting key 18fb533c2d9e54d7ebab66a7e43408cc
I20260619 06:41:26.039155 24537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:41:26.046294 24537 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.10.192.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.125@KRBTEST.COM" created.
Jun 19 06:41:26 dist-test-slave-7lz4 krb5kdc[24457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851285, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:26.071400 24540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.050460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52414 (local address 127.10.192.126:43363)
0619 06:41:26.051389 (+ 929us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:26.051406 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:26.052019 (+ 613us) server_negotiation.cc:407] Connection header received
0619 06:41:26.054065 (+ 2046us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:26.054076 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:26.054411 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:26.054644 (+ 233us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:26.055965 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:26.058052 (+ 2087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:26.059449 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:26.060293 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:26.060431 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:26.064017 (+ 3586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:26.064024 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:26.064037 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:26.064066 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:26.066854 (+ 2788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:26.067551 (+ 697us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:26.067566 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:26.067568 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:26.067793 (+ 225us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:26.068188 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:26.068193 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:26.068196 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:26.068733 (+ 537us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:26.068945 (+ 212us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:26.069485 (+ 540us) server_negotiation.cc:299] Negotiation successful
0619 06:41:26.069906 (+ 421us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":662,"thread_start_us":411,"threads_started":1}
I20260619 06:41:26.071424 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.050460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:43363 (local address 127.0.0.1:52414)
0619 06:41:26.051827 (+ 1367us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.051871 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:26.053686 (+ 1815us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:26.054671 (+ 985us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:26.054676 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:26.055246 (+ 570us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:26.055754 (+ 508us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:26.055776 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:26.058222 (+ 2446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:26.058233 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:26.059298 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:26.059310 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:26.060499 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:26.060504 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:26.060624 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:26.061320 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:26.061343 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:26.063791 (+ 2448us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:26.066990 (+ 3199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:26.067002 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:26.067015 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:26.067414 (+ 399us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:26.067907 (+ 493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:26.067914 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:26.067919 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:26.068076 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:26.068871 (+ 795us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:26.068879 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:26.069120 (+ 241us) client_negotiation.cc:769] Sending connection context
0619 06:41:26.069370 (+ 250us) client_negotiation.cc:240] Negotiation successful
0619 06:41:26.070021 (+ 651us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1081,"mutex_wait_us":190,"spinlock_wait_cycles":15744,"thread_start_us":857,"threads_started":1}
I20260619 06:41:26.074936 24537 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } has no permanent_uuid. Determining permanent_uuid...
I20260619 06:41:26.076340 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.075767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:33003 (local address 127.0.0.1:59088)
0619 06:41:26.075986 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.076150 (+ 164us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:33003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
W20260619 06:41:26.076634 24486 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.192.125:33003: connect: Connection refused (error 111)
I20260619 06:41:26.078296 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.077933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:33003 (local address 127.0.0.1:59090)
0619 06:41:26.078084 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.078173 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:33003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260619 06:41:26.078512 24537 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.125:33003: Network error: Client connection negotiation failed: client connection to 127.10.192.125:33003: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.125.keytab.
Entry for principal kudu/127.10.192.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.125.keytab.
I20260619 06:41:26.090703 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.125:33003
--webserver_interface=127.10.192.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.125.keytab
--principal=kudu/127.10.192.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:46857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:43363,127.10.192.125:33003,127.10.192.124:41639
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:41:26.127894 24537 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } attempt: 1
I20260619 06:41:26.129060 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.128592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:33003 (local address 127.0.0.1:59094)
0619 06:41:26.128804 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.128922 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:33003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260619 06:41:26.130126 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.129810 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:33003 (local address 127.0.0.1:59100)
0619 06:41:26.129938 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.130005 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:33003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260619 06:41:26.130419 24537 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.125:33003: Network error: Client connection negotiation failed: client connection to 127.10.192.125:33003: connect: Connection refused (error 111)
I20260619 06:41:26.198657 24537 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } attempt: 2
I20260619 06:41:26.199884 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.199398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:33003 (local address 127.0.0.1:59104)
0619 06:41:26.199642 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.199751 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:33003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260619 06:41:26.200891 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.200565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:33003 (local address 127.0.0.1:59114)
0619 06:41:26.200706 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.200776 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:33003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260619 06:41:26.201120 24537 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.125:33003: Network error: Client connection negotiation failed: client connection to 127.10.192.125:33003: connect: Connection refused (error 111)
I20260619 06:41:26.292373 24537 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } attempt: 3
I20260619 06:41:26.293690 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.293227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:33003 (local address 127.0.0.1:59130)
0619 06:41:26.293442 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.293542 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:33003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260619 06:41:26.294880 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.294524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:33003 (local address 127.0.0.1:59138)
0619 06:41:26.294668 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.294751 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:33003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260619 06:41:26.295126 24537 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.125:33003: Network error: Client connection negotiation failed: client connection to 127.10.192.125:33003: connect: Connection refused (error 111)
W20260619 06:41:26.433703 24544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:26.434028 24544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:26.434255 24544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260619 06:41:26.438401 24537 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } attempt: 4
I20260619 06:41:26.439746 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.439178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:33003 (local address 127.0.0.1:59142)
0619 06:41:26.439478 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.439585 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:33003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176}
I20260619 06:41:26.440840 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.440513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:33003 (local address 127.0.0.1:59144)
0619 06:41:26.440647 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.440716 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:33003: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260619 06:41:26.441063 24537 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.125:33003: Network error: Client connection negotiation failed: client connection to 127.10.192.125:33003: connect: Connection refused (error 111)
W20260619 06:41:26.442821 24544 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:41:26.442955 24544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:26.443043 24544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:26.443161 24544 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:41:26.443248 24544 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:41:26.453924 24544 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:46857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:43363,127.10.192.125:33003,127.10.192.124:41639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.125.keytab
--principal=kudu/127.10.192.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.125:33003
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.192.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:26.455384 24544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:26.456851 24544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:26.469003 24549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:26.469003 24550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:26.469040 24552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:26.470279 24544 server_base.cc:1034] running on GCE node
I20260619 06:41:26.471025 24544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:26.472506 24544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:26.473707 24544 hybrid_clock.cc:648] HybridClock initialized: now 1781851286473661 us; error 37 us; skew 500 ppm
I20260619 06:41:26.474073 24544 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:26 dist-test-slave-7lz4 krb5kdc[24457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851286, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:26.478121 24544 init.cc:377] Logged in from keytab as kudu/127.10.192.125@KRBTEST.COM (short username kudu)
I20260619 06:41:26.479540 24544 webserver.cc:460] Webserver started at http://127.10.192.125:40753/ using document root <none> and password file <none>
I20260619 06:41:26.480288 24544 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:26.480391 24544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:26.480624 24544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:41:26.483489 24544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-1/data/instance:
uuid: "966a73ffa7c849fe9364c6b09bb686a6"
format_stamp: "Formatted at 2026-06-19 06:41:26 on dist-test-slave-7lz4"
server_key: "82706e368b8b18e69111bda2002bfc15"
server_key_iv: "7eeef1e575b02dce1b0fbba8f3afd899"
server_key_version: "encryptionkey@0"
I20260619 06:41:26.484309 24544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-1/wal/instance:
uuid: "966a73ffa7c849fe9364c6b09bb686a6"
format_stamp: "Formatted at 2026-06-19 06:41:26 on dist-test-slave-7lz4"
server_key: "82706e368b8b18e69111bda2002bfc15"
server_key_iv: "7eeef1e575b02dce1b0fbba8f3afd899"
server_key_version: "encryptionkey@0"
I20260619 06:41:26.489519 24544 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 06:41:26.493010 24559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:26.494405 24544 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:41:26.494589 24544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-1/wal
uuid: "966a73ffa7c849fe9364c6b09bb686a6"
format_stamp: "Formatted at 2026-06-19 06:41:26 on dist-test-slave-7lz4"
server_key: "82706e368b8b18e69111bda2002bfc15"
server_key_iv: "7eeef1e575b02dce1b0fbba8f3afd899"
server_key_version: "encryptionkey@0"
I20260619 06:41:26.494791 24544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:26.518671 24544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:26.523247 24544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:26.523554 24544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:26.542634 24544 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.125:33003
I20260619 06:41:26.542665 24610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.125:33003 every 8 connection(s)
I20260619 06:41:26.544175 24544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-1/data/info.pb
I20260619 06:41:26.548213 24611 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:41:26.553663 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 24544
I20260619 06:41:26.553839 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-1/wal/instance
I20260619 06:41:26.554369 11009 external_mini_cluster.cc:1428] Setting key a85a441ca1a132ccbb3b97882a01d63f
I20260619 06:41:26.555408 24611 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 06:41:26 dist-test-slave-7lz4 krb5kdc[24457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851286, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.125@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.192.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.124@KRBTEST.COM" created.
I20260619 06:41:26.578955 24540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.558913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52426 (local address 127.10.192.126:43363)
0619 06:41:26.559134 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:26.559140 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:26.560496 (+ 1356us) server_negotiation.cc:407] Connection header received
0619 06:41:26.562387 (+ 1891us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:26.562393 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:26.562485 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:26.562595 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:26.564718 (+ 2123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:26.565423 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:26.567926 (+ 2503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:26.568348 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:26.568448 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:26.572788 (+ 4340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:26.572793 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:26.572796 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:26.572833 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:26.575538 (+ 2705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:26.576368 (+ 830us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:26.576374 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:26.576382 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:26.576515 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:26.577083 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:26.577088 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:26.577123 (+ 35us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:26.577483 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:26.577657 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:26.578374 (+ 717us) server_negotiation.cc:299] Negotiation successful
0619 06:41:26.578617 (+ 243us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260619 06:41:26.580082 24613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.559462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:43363 (local address 127.0.0.1:52426)
0619 06:41:26.560307 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.560360 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:26.562107 (+ 1747us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:26.562888 (+ 781us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:26.562902 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:26.563706 (+ 804us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:26.564512 (+ 806us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:26.564539 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:26.565593 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:26.565601 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:26.567778 (+ 2177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:26.567797 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:26.568582 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:26.568592 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:26.568933 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:26.569695 (+ 762us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:26.569742 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:26.572524 (+ 2782us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:26.575743 (+ 3219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:26.575754 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:26.575772 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:26.576236 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:26.576754 (+ 518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:26.576759 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:26.576763 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:26.576956 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:26.577615 (+ 659us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:26.577623 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:26.577993 (+ 370us) client_negotiation.cc:769] Sending connection context
0619 06:41:26.578271 (+ 278us) client_negotiation.cc:240] Negotiation successful
0619 06:41:26.578850 (+ 579us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":398,"threads_started":1}
I20260619 06:41:26.581820 24611 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 06:41:26 dist-test-slave-7lz4 krb5kdc[24457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851286, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.125@KRBTEST.COM for kudu/127.10.192.125@KRBTEST.COM
I20260619 06:41:26.596465 24613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.582589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:33003 (local address 127.0.0.1:59146)
0619 06:41:26.582828 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.582849 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:26.582964 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:26.584003 (+ 1039us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:26.584010 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:26.584511 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:26.584735 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:26.584751 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:26.586188 (+ 1437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:26.586194 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:26.587019 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:26.587029 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:26.587875 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:26.587880 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:26.588066 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:26.588657 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:26.588674 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:26.590618 (+ 1944us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:26.593915 (+ 3297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:26.593920 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:26.593924 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:26.594286 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:26.594662 (+ 376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:26.594667 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:26.594670 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:26.594811 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:26.595413 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:26.595421 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:26.595562 (+ 141us) client_negotiation.cc:769] Sending connection context
0619 06:41:26.595723 (+ 161us) client_negotiation.cc:240] Negotiation successful
0619 06:41:26.596049 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260619 06:41:26.596565 24615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.582863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59146 (local address 127.10.192.125:33003)
0619 06:41:26.583539 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:26.583544 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:26.583569 (+ 25us) server_negotiation.cc:407] Connection header received
0619 06:41:26.583611 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:26.583618 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:26.583851 (+ 233us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:26.583964 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:26.584941 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:26.586051 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:26.587154 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:26.587743 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:26.587867 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:26.590819 (+ 2952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:26.590831 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:26.590844 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:26.590875 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:26.593754 (+ 2879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:26.594423 (+ 669us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:26.594432 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:26.594435 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:26.594548 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:26.594916 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:26.594923 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:26.594926 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:26.595274 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:26.595495 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:26.595856 (+ 361us) server_negotiation.cc:299] Negotiation successful
0619 06:41:26.596173 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":86,"server-negotiator.queue_time_us":528,"thread_start_us":390,"threads_started":1}
I20260619 06:41:26.599354 24611 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } has no permanent_uuid. Determining permanent_uuid...
I20260619 06:41:26.600598 24613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.600113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:59896)
0619 06:41:26.600279 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.600417 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260619 06:41:26.600852 24562 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
I20260619 06:41:26.602429 24613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.602063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:59912)
0619 06:41:26.602244 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.602318 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260619 06:41:26.602666 24611 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:41639: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.124.keytab.
Entry for principal kudu/127.10.192.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.124.keytab.
I20260619 06:41:26.605239 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.124:41639
--webserver_interface=127.10.192.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.124.keytab
--principal=kudu/127.10.192.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:46857
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:43363,127.10.192.125:33003,127.10.192.124:41639
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:41:26.651962 24611 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } attempt: 1
I20260619 06:41:26.653318 24613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.652654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:59916)
0619 06:41:26.652918 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.653072 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260619 06:41:26.654536 24613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.654036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:59928)
0619 06:41:26.654248 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.654360 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260619 06:41:26.654795 24611 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:41639: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
I20260619 06:41:26.723007 24611 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } attempt: 2
I20260619 06:41:26.724248 24613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.723700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:59930)
0619 06:41:26.723923 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.724041 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260619 06:41:26.725298 24613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.724901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:59936)
0619 06:41:26.725052 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.725141 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260619 06:41:26.725493 24611 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:41639: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
I20260619 06:41:26.740407 24537 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } attempt: 5
Jun 19 06:41:26 dist-test-slave-7lz4 krb5kdc[24457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851285, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for kudu/127.10.192.125@KRBTEST.COM
I20260619 06:41:26.754829 24615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.741253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59162 (local address 127.10.192.125:33003)
0619 06:41:26.741431 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:26.741439 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:26.741533 (+ 94us) server_negotiation.cc:407] Connection header received
0619 06:41:26.741736 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:26.741746 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:26.741822 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:26.741925 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:26.742673 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:26.743365 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:26.744881 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:26.745714 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:26.745857 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:26.749471 (+ 3614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:26.749476 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:26.749480 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:26.749513 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:26.752241 (+ 2728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:26.752994 (+ 753us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:26.752998 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:26.753001 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:26.753113 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:26.753520 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:26.753523 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:26.753525 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:26.753802 (+ 277us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:26.753908 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:26.754430 (+ 522us) server_negotiation.cc:299] Negotiation successful
0619 06:41:26.754598 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 06:41:26.755234 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.741174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:33003 (local address 127.0.0.1:59162)
0619 06:41:26.741423 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.741444 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:26.741611 (+ 167us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:26.741961 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:26.741965 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:26.742362 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:26.742512 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:26.742521 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:26.743501 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:26.743507 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:26.744692 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:26.744713 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:26.745867 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:26.745871 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:26.746002 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:26.746630 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:26.746648 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:26.749278 (+ 2630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:26.752373 (+ 3095us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:26.752378 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:26.752382 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:26.752889 (+ 507us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:26.753228 (+ 339us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:26.753235 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:26.753241 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:26.753422 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:26.753927 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:26.753933 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:26.754130 (+ 197us) client_negotiation.cc:769] Sending connection context
0619 06:41:26.754347 (+ 217us) client_negotiation.cc:240] Negotiation successful
0619 06:41:26.754749 (+ 402us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110}
I20260619 06:41:26.756292 24537 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } has no permanent_uuid. Determining permanent_uuid...
I20260619 06:41:26.757416 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.756971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:59952)
0619 06:41:26.757159 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.757255 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260619 06:41:26.758410 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.758022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:59966)
0619 06:41:26.758197 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.758281 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260619 06:41:26.758636 24537 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:41639: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
I20260619 06:41:26.809885 24537 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } attempt: 1
I20260619 06:41:26.811159 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.810577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:59980)
0619 06:41:26.810833 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.810958 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260619 06:41:26.812458 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.812033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:59986)
0619 06:41:26.812216 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.812326 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260619 06:41:26.812696 24537 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:41639: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
I20260619 06:41:26.816718 24611 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } attempt: 3
I20260619 06:41:26.817750 24613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.817247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:59992)
0619 06:41:26.817452 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.817551 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
I20260619 06:41:26.818954 24613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.818476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:59994)
0619 06:41:26.818706 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.818811 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
W20260619 06:41:26.819200 24611 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:41639: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
I20260619 06:41:26.880932 24537 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } attempt: 2
I20260619 06:41:26.882330 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.881667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:60000)
0619 06:41:26.881975 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.882103 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260619 06:41:26.883469 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.883047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:60012)
0619 06:41:26.883229 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.883329 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260619 06:41:26.883752 24537 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:41639: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
W20260619 06:41:26.939522 24618 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:26.939896 24618 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:26.939997 24618 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:26.947414 24618 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:41:26.947522 24618 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:26.947568 24618 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:26.947666 24618 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:41:26.947727 24618 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:41:26.957842 24618 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:46857
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:43363,127.10.192.125:33003,127.10.192.124:41639
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.124.keytab
--principal=kudu/127.10.192.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.124:41639
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.192.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:26.959154 24618 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:26.960798 24618 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260619 06:41:26.962425 24611 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } attempt: 4
I20260619 06:41:26.963671 24613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.963091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:60026)
0619 06:41:26.963343 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.963451 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260619 06:41:26.964847 24613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.964450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:60030)
0619 06:41:26.964607 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.964703 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260619 06:41:26.965111 24611 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:41639: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
W20260619 06:41:26.973628 24623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:26.973687 24624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:26.973665 24626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:26.974817 24618 server_base.cc:1034] running on GCE node
I20260619 06:41:26.975589 24618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:26.977102 24618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:26.978327 24618 hybrid_clock.cc:648] HybridClock initialized: now 1781851286978269 us; error 63 us; skew 500 ppm
I20260619 06:41:26.978663 24618 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:26 dist-test-slave-7lz4 krb5kdc[24457](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851286, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:26.981756 24618 init.cc:377] Logged in from keytab as kudu/127.10.192.124@KRBTEST.COM (short username kudu)
I20260619 06:41:26.983189 24618 webserver.cc:460] Webserver started at http://127.10.192.124:41685/ using document root <none> and password file <none>
I20260619 06:41:26.983924 24618 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:26.984055 24618 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:26.984342 24618 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:41:26.987318 24618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-2/data/instance:
uuid: "ecbb3c2979174c6b973fb7cae6cd0915"
format_stamp: "Formatted at 2026-06-19 06:41:26 on dist-test-slave-7lz4"
server_key: "9c55dbec9bb32bfec6b511bdd48f50bb"
server_key_iv: "4e93a9a11257e9173e4d9d6d8fde4c8c"
server_key_version: "encryptionkey@0"
I20260619 06:41:26.988129 24618 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-2/wal/instance:
uuid: "ecbb3c2979174c6b973fb7cae6cd0915"
format_stamp: "Formatted at 2026-06-19 06:41:26 on dist-test-slave-7lz4"
server_key: "9c55dbec9bb32bfec6b511bdd48f50bb"
server_key_iv: "4e93a9a11257e9173e4d9d6d8fde4c8c"
server_key_version: "encryptionkey@0"
I20260619 06:41:26.989969 24537 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } attempt: 3
I20260619 06:41:26.991042 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.990626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:60034)
0619 06:41:26.990803 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.990884 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260619 06:41:26.992017 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:26.991666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:60036)
0619 06:41:26.991851 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:26.991921 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
W20260619 06:41:26.992398 24537 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:41639: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41639: connect: Connection refused (error 111)
I20260619 06:41:26.993853 24618 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260619 06:41:26.997273 24633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:26.998747 24618 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 06:41:26.998924 24618 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-2/wal
uuid: "ecbb3c2979174c6b973fb7cae6cd0915"
format_stamp: "Formatted at 2026-06-19 06:41:26 on dist-test-slave-7lz4"
server_key: "9c55dbec9bb32bfec6b511bdd48f50bb"
server_key_iv: "4e93a9a11257e9173e4d9d6d8fde4c8c"
server_key_version: "encryptionkey@0"
I20260619 06:41:26.999166 24618 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:27.025730 24618 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:27.030484 24618 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:27.030797 24618 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:27.049953 24618 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.124:41639
I20260619 06:41:27.049983 24684 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.124:41639 every 8 connection(s)
I20260619 06:41:27.051334 24618 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-2/data/info.pb
I20260619 06:41:27.055018 24685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:41:27.057204 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 24618
I20260619 06:41:27.057401 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACert.1781851080573990-11009-0/minicluster-data/master-2/wal/instance
I20260619 06:41:27.057857 11009 external_mini_cluster.cc:1428] Setting key b67ff1c6b19901d4ec9f3b97fea57a91
I20260619 06:41:27.062391 24685 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 06:41:27 dist-test-slave-7lz4 krb5kdc[24457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.124@KRBTEST.COM
Jun 19 06:41:27 dist-test-slave-7lz4 krb5kdc[24457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851286, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.124@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:27.079563 24540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:27.065467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52442 (local address 127.10.192.126:43363)
0619 06:41:27.065651 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:27.065658 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:27.066247 (+ 589us) server_negotiation.cc:407] Connection header received
0619 06:41:27.066449 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:27.066459 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:27.066522 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:27.066624 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:27.067854 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.068533 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.069901 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.070325 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.070455 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:27.073968 (+ 3513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:27.073974 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:27.073977 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:27.074009 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:27.076697 (+ 2688us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.077409 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.077414 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.077418 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.077551 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.077961 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.077968 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.077972 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.078247 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:27.078409 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:27.078950 (+ 541us) server_negotiation.cc:299] Negotiation successful
0619 06:41:27.079192 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260619 06:41:27.080700 24689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:27.065456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:43363 (local address 127.0.0.1:52442)
0619 06:41:27.066078 (+ 622us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:27.066117 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:27.066322 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:27.066700 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:27.066707 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:27.067386 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:27.067703 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:27.067719 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.068694 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.068699 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:27.069759 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:27.069770 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.070550 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.070558 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:27.070722 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:27.071336 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:27.071361 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:27.073766 (+ 2405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:27.076839 (+ 3073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:27.076852 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:27.076865 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:27.077286 (+ 421us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:27.077661 (+ 375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:27.077666 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:27.077677 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:27.077851 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:27.078376 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:27.078385 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:27.078610 (+ 225us) client_negotiation.cc:769] Sending connection context
0619 06:41:27.078876 (+ 266us) client_negotiation.cc:240] Negotiation successful
0619 06:41:27.079400 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":293,"threads_started":1}
I20260619 06:41:27.080706 24688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:27.059827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60050 (local address 127.10.192.124:41639)
0619 06:41:27.060637 (+ 810us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:27.060649 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:27.060688 (+ 39us) server_negotiation.cc:407] Connection header received
0619 06:41:27.062278 (+ 1590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:27.062299 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:27.062696 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:27.063019 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:27.065161 (+ 2142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.066998 (+ 1837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.068440 (+ 1442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.069112 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.069313 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:27.073779 (+ 4466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:27.073787 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:27.073799 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:27.073829 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:27.076696 (+ 2867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.077441 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.077447 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.077449 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.077597 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.077999 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.078003 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.078005 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.078539 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:27.078847 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:27.079161 (+ 314us) server_negotiation.cc:299] Negotiation successful
0619 06:41:27.079573 (+ 412us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":126,"server-negotiator.queue_time_us":599,"thread_start_us":387,"threads_started":1}
I20260619 06:41:27.082754 24685 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 06:41:27 dist-test-slave-7lz4 krb5kdc[24457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851286, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.124@KRBTEST.COM for kudu/127.10.192.125@KRBTEST.COM
Jun 19 06:41:27 dist-test-slave-7lz4 krb5kdc[24457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:27.097245 24689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:27.083598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:33003 (local address 127.0.0.1:59164)
0619 06:41:27.083816 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:27.083837 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:27.083936 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:27.084472 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:27.084477 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:27.084943 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:27.085103 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:27.085158 (+ 55us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.086211 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.086218 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:27.087075 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:27.087085 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.087810 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.087815 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:27.088022 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:27.088591 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:27.088609 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:27.090680 (+ 2071us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:27.094417 (+ 3737us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:27.094422 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:27.094424 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:27.095020 (+ 596us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:27.095490 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:27.095495 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:27.095498 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:27.095705 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:27.096230 (+ 525us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:27.096235 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:27.096398 (+ 163us) client_negotiation.cc:769] Sending connection context
0619 06:41:27.096551 (+ 153us) client_negotiation.cc:240] Negotiation successful
0619 06:41:27.096849 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108}
I20260619 06:41:27.097266 24615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:27.083581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59164 (local address 127.10.192.125:33003)
0619 06:41:27.083808 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:27.083814 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:27.083894 (+ 80us) server_negotiation.cc:407] Connection header received
0619 06:41:27.084084 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:27.084089 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:27.084178 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:27.084279 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:27.085298 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.086079 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.087214 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.087667 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.087802 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:27.090886 (+ 3084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:27.090896 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:27.090899 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:27.090932 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:27.094280 (+ 3348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.095152 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.095157 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.095160 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.095292 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.095820 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.095825 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.095828 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.096113 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:27.096273 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:27.096649 (+ 376us) server_negotiation.cc:299] Negotiation successful
0619 06:41:27.096861 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260619 06:41:27.098357 24685 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } has no permanent_uuid. Determining permanent_uuid...
I20260619 06:41:27.098928 24540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:27.084315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52448 (local address 127.10.192.126:43363)
0619 06:41:27.084524 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:27.084531 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:27.084550 (+ 19us) server_negotiation.cc:407] Connection header received
0619 06:41:27.084601 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:27.084616 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:27.084691 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:27.084792 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:27.086029 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.086766 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.088049 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.088454 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.088571 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:27.093041 (+ 4470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:27.093047 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:27.093050 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:27.093084 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:27.095970 (+ 2886us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.096678 (+ 708us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.096688 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.096690 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.096840 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.097257 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.097263 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.097266 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.097656 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:27.097952 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:27.098347 (+ 395us) server_negotiation.cc:299] Negotiation successful
0619 06:41:27.098606 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
Jun 19 06:41:27 dist-test-slave-7lz4 krb5kdc[24457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851286, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.124@KRBTEST.COM for kudu/127.10.192.124@KRBTEST.COM
Jun 19 06:41:27 dist-test-slave-7lz4 krb5kdc[24457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851285, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.125@KRBTEST.COM
I20260619 06:41:27.112804 24689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:27.099282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:60054)
0619 06:41:27.099465 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:27.099482 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:27.099576 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:27.100015 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:27.100019 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:27.100385 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:27.100509 (+ 124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:27.100540 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.101719 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.101726 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:27.103031 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:27.103043 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.103991 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.103996 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:27.104216 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:27.104869 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:27.104887 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:27.107106 (+ 2219us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:27.110428 (+ 3322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:27.110432 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:27.110435 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:27.110770 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:27.111204 (+ 434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:27.111208 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:27.111210 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:27.111337 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:27.111966 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:27.111970 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:27.112080 (+ 110us) client_negotiation.cc:769] Sending connection context
0619 06:41:27.112235 (+ 155us) client_negotiation.cc:240] Negotiation successful
0619 06:41:27.112446 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54,"mutex_wait_us":19}
I20260619 06:41:27.113057 24688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:27.099612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60054 (local address 127.10.192.124:41639)
0619 06:41:27.099787 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:27.099791 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:27.099804 (+ 13us) server_negotiation.cc:407] Connection header received
0619 06:41:27.099847 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:27.099850 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:27.099897 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:27.100003 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:27.100691 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.101584 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.103166 (+ 1582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.103847 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.103981 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:27.107291 (+ 3310us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:27.107297 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:27.107302 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:27.107336 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:27.110288 (+ 2952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.110883 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.110891 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.110897 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.111034 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.111441 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.111446 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.111448 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.111846 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:27.111987 (+ 141us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:27.112362 (+ 375us) server_negotiation.cc:299] Negotiation successful
0619 06:41:27.112608 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":25,"server-negotiator.queue_time_us":81}
I20260619 06:41:27.115617 24615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:27.100787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59172 (local address 127.10.192.125:33003)
0619 06:41:27.100948 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:27.100954 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:27.100970 (+ 16us) server_negotiation.cc:407] Connection header received
0619 06:41:27.101014 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:27.101019 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:27.101082 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:27.101180 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:27.102596 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.103402 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.104792 (+ 1390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.105213 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.105308 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:27.109445 (+ 4137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:27.109452 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:27.109457 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:27.109498 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:27.112616 (+ 3118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.113470 (+ 854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.113481 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.113483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.113645 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.114206 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.114210 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.114212 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.114467 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:27.114772 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:27.115079 (+ 307us) server_negotiation.cc:299] Negotiation successful
0619 06:41:27.115312 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260619 06:41:27.118181 24685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915: Bootstrap starting.
I20260619 06:41:27.120522 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:41:27.121795 24685 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915: Neither blocks nor log segments found. Creating new log.
I20260619 06:41:27.122843 24685 log.cc:824] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:27.126417 24685 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915: No bootstrap required, opened a new log
I20260619 06:41:27.140877 24685 raft_consensus.cc:348] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } } peers { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } } peers { permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } }
I20260619 06:41:27.141392 24685 raft_consensus.cc:374] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:41:27.141532 24685 raft_consensus.cc:729] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecbb3c2979174c6b973fb7cae6cd0915, State: Initialized, Role: FOLLOWER
I20260619 06:41:27.142383 24685 consensus_queue.cc:260] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } } peers { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } } peers { permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } }
I20260619 06:41:27.147969 24698 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } } peers { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } } peers { permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } } }
I20260619 06:41:27.148605 24698 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:41:27.149629 24685 sys_catalog.cc:564] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:41:27.156169 24540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:27.125825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52450 (local address 127.10.192.126:43363)
0619 06:41:27.126058 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:27.126067 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:27.136678 (+ 10611us) server_negotiation.cc:407] Connection header received
0619 06:41:27.136913 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:27.136924 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:27.137040 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:27.137161 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:27.140707 (+ 3546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.141915 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.144068 (+ 2153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.144706 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.144828 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:27.149036 (+ 4208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:27.149044 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:27.149051 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:27.149114 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:27.152849 (+ 3735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.153683 (+ 834us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.153689 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.153694 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.153874 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.154315 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.154322 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.154328 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.154706 (+ 378us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:27.154977 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:27.155514 (+ 537us) server_negotiation.cc:299] Negotiation successful
0619 06:41:27.155809 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260619 06:41:27.157718 24615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:27.125849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59182 (local address 127.10.192.125:33003)
0619 06:41:27.131472 (+ 5623us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:27.131482 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:27.138990 (+ 7508us) server_negotiation.cc:407] Connection header received
0619 06:41:27.139176 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:27.139182 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:27.139267 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:27.139366 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:27.142063 (+ 2697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.143179 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.145451 (+ 2272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.146150 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.146281 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:27.150680 (+ 4399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:27.150686 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:27.150692 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:27.150741 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:27.154286 (+ 3545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.155037 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.155042 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.155045 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.155202 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.155698 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.155706 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.155711 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.156069 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:27.156593 (+ 524us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:27.157135 (+ 542us) server_negotiation.cc:299] Negotiation successful
0619 06:41:27.157377 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5412}
I20260619 06:41:27.160288 24688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:27.125888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60056 (local address 127.10.192.124:41639)
0619 06:41:27.126099 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:27.126108 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:27.138104 (+ 11996us) server_negotiation.cc:407] Connection header received
0619 06:41:27.138407 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:27.138414 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:27.138498 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:27.138567 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:27.141123 (+ 2556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.142207 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.144926 (+ 2719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.145932 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.146054 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:27.152153 (+ 6099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:27.152162 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:27.152181 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:27.152237 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:27.156959 (+ 4722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.157976 (+ 1017us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.157985 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.157991 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.158197 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.158689 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.158694 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.158697 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.159087 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:27.159342 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:27.159670 (+ 328us) server_negotiation.cc:299] Negotiation successful
0619 06:41:27.159921 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 06:41:27.169644 24537 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } attempt: 4
W20260619 06:41:27.173681 24709 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 06:41:27.173818 24709 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Jun 19 06:41:27 dist-test-slave-7lz4 krb5kdc[24457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851285, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for kudu/127.10.192.124@KRBTEST.COM
I20260619 06:41:27.170140 24618 master_runner.cc:186] Error getting master registration for 127.10.192.126:43363: OK, instance_id { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" instance_seqno: 1781851286028486 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 06:41:27.182873 24618 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260619 06:41:27.185848 24541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:27.170187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:60070)
0619 06:41:27.170347 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:27.170365 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:27.170457 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:27.171549 (+ 1092us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:27.171554 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:27.172082 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:27.172320 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:27.172333 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.173894 (+ 1561us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.173900 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:27.174855 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:27.174868 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.175616 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.175622 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:27.175852 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:27.176464 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:27.176482 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:27.179817 (+ 3335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:27.183241 (+ 3424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:27.183246 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:27.183250 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:27.183722 (+ 472us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:27.184085 (+ 363us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:27.184091 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:27.184094 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:27.184244 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:27.184810 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:27.184815 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:27.184976 (+ 161us) client_negotiation.cc:769] Sending connection context
0619 06:41:27.185110 (+ 134us) client_negotiation.cc:240] Negotiation successful
0619 06:41:27.185439 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260619 06:41:27.186003 24688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:27.170838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60070 (local address 127.10.192.124:41639)
0619 06:41:27.171030 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:27.171036 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:27.171055 (+ 19us) server_negotiation.cc:407] Connection header received
0619 06:41:27.171105 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:27.171110 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:27.171231 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:27.171334 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:27.172498 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.173710 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.175000 (+ 1290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.175453 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.175592 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:27.180007 (+ 4415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:27.180013 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:27.180020 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:27.180050 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:27.183103 (+ 3053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.183844 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.183850 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.183854 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.183973 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.184354 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.184359 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.184362 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.184682 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:27.184844 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:27.185221 (+ 377us) server_negotiation.cc:299] Negotiation successful
0619 06:41:27.185441 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260619 06:41:27.191272 24537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8: Bootstrap starting.
I20260619 06:41:27.194926 24537 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8: Neither blocks nor log segments found. Creating new log.
I20260619 06:41:27.196177 24537 log.cc:824] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:27.199183 24537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8: No bootstrap required, opened a new log
I20260619 06:41:27.207130 24537 raft_consensus.cc:348] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } } peers { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } } peers { permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } }
I20260619 06:41:27.207511 24537 raft_consensus.cc:374] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:41:27.207597 24537 raft_consensus.cc:729] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96a7463fe0df46ea8b4c6c750b7e79c8, State: Initialized, Role: FOLLOWER
I20260619 06:41:27.208303 24537 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } } peers { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } } peers { permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } }
I20260619 06:41:27.209316 24712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } } peers { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } } peers { permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } } }
I20260619 06:41:27.209721 24712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:41:27.210515 24537 sys_catalog.cc:564] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [sys.catalog]: configured and running, proceeding with master startup.
W20260619 06:41:27.223389 24723 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 06:41:27.223752 24723 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 06:41:27.219353 24470 master_runner.cc:186] Error getting master registration for 127.10.192.125:33003: OK, instance_id { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" instance_seqno: 1781851286537217 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 06:41:27.230427 24470 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260619 06:41:27.264357 24611 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } attempt: 5
W20260619 06:41:27.267910 24491 tablet.cc:2369] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
Jun 19 06:41:27 dist-test-slave-7lz4 krb5kdc[24457](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851286, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.125@KRBTEST.COM for kudu/127.10.192.124@KRBTEST.COM
W20260619 06:41:27.282998 24639 tablet.cc:2369] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:41:27.284603 24613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:27.265077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41639 (local address 127.0.0.1:60078)
0619 06:41:27.265366 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:27.265386 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:27.265501 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:27.266088 (+ 587us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:27.266093 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:27.266632 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:27.266862 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:27.266875 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.268521 (+ 1646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.268527 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:27.270039 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:27.270057 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.271131 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.271138 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:27.271394 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:27.272168 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:27.272194 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:27.276876 (+ 4682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:27.281285 (+ 4409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:27.281292 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:27.281296 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:27.281866 (+ 570us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:27.282305 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:27.282310 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:27.282314 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:27.282523 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:27.283489 (+ 966us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:27.283495 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:27.283708 (+ 213us) client_negotiation.cc:769] Sending connection context
0619 06:41:27.283872 (+ 164us) client_negotiation.cc:240] Negotiation successful
0619 06:41:27.284197 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142}
I20260619 06:41:27.285665 24688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:27.265165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60078 (local address 127.10.192.124:41639)
0619 06:41:27.265362 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:27.265368 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:27.265609 (+ 241us) server_negotiation.cc:407] Connection header received
0619 06:41:27.265675 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:27.265681 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:27.265803 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:27.265895 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:27.267026 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.268218 (+ 1192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.270207 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:27.270948 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:27.271085 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:27.277093 (+ 6008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:27.277100 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:27.277106 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:27.277149 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:27.281112 (+ 3963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.282010 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.282017 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.282021 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.282176 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:27.282642 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:27.282647 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:27.282652 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:27.283092 (+ 440us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:27.283432 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:27.284978 (+ 1546us) server_negotiation.cc:299] Negotiation successful
0619 06:41:27.285247 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260619 06:41:27.291867 24611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6: Bootstrap starting.
I20260619 06:41:27.296273 24611 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6: Neither blocks nor log segments found. Creating new log.
I20260619 06:41:27.297736 24611 log.cc:824] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:27.301635 24611 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6: No bootstrap required, opened a new log
I20260619 06:41:27.313936 24611 raft_consensus.cc:348] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } } peers { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } } peers { permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } }
I20260619 06:41:27.314453 24611 raft_consensus.cc:374] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:41:27.314589 24611 raft_consensus.cc:729] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 966a73ffa7c849fe9364c6b09bb686a6, State: Initialized, Role: FOLLOWER
I20260619 06:41:27.315418 24611 consensus_queue.cc:260] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } } peers { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } } peers { permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } }
I20260619 06:41:27.317088 24726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } } peers { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } } peers { permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } } }
I20260619 06:41:27.317551 24726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:41:27.318559 24611 sys_catalog.cc:564] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:41:27.341749 24544 master_runner.cc:263] No leader master found from master 966a73ffa7c849fe9364c6b09bb686a6
I20260619 06:41:27.341922 24544 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260619 06:41:27.344502 24737 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 06:41:27.344749 24737 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 06:41:27.443889 24712 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:41:27.444265 24712 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } } peers { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } } peers { permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } }
I20260619 06:41:27.446043 24712 leader_election.cc:288] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 966a73ffa7c849fe9364c6b09bb686a6 (127.10.192.125:33003), ecbb3c2979174c6b973fb7cae6cd0915 (127.10.192.124:41639)
I20260619 06:41:27.447356 24660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" is_pre_election: true
I20260619 06:41:27.448100 24660 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96a7463fe0df46ea8b4c6c750b7e79c8 in term 0.
I20260619 06:41:27.449600 24488 leader_election.cc:302] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 96a7463fe0df46ea8b4c6c750b7e79c8, ecbb3c2979174c6b973fb7cae6cd0915; no voters:
I20260619 06:41:27.450852 24586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "966a73ffa7c849fe9364c6b09bb686a6" is_pre_election: true
I20260619 06:41:27.451469 24586 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96a7463fe0df46ea8b4c6c750b7e79c8 in term 0.
I20260619 06:41:27.452538 24712 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:41:27.452714 24712 raft_consensus.cc:482] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:41:27.452845 24712 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:41:27.460264 24712 raft_consensus.cc:504] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } } peers { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } } peers { permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } }
I20260619 06:41:27.463444 24586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "966a73ffa7c849fe9364c6b09bb686a6"
I20260619 06:41:27.463790 24586 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:41:27.467540 24586 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96a7463fe0df46ea8b4c6c750b7e79c8 in term 1.
I20260619 06:41:27.468536 24486 leader_election.cc:302] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 966a73ffa7c849fe9364c6b09bb686a6, 96a7463fe0df46ea8b4c6c750b7e79c8; no voters:
I20260619 06:41:27.472682 24660 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecbb3c2979174c6b973fb7cae6cd0915"
I20260619 06:41:27.472952 24660 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:41:27.476541 24660 raft_consensus.cc:2454] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96a7463fe0df46ea8b4c6c750b7e79c8 in term 1.
I20260619 06:41:27.477381 24712 leader_election.cc:288] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [CANDIDATE]: Term 1 election: Requested vote from peers 966a73ffa7c849fe9364c6b09bb686a6 (127.10.192.125:33003), ecbb3c2979174c6b973fb7cae6cd0915 (127.10.192.124:41639)
I20260619 06:41:27.482004 24712 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:41:27.482378 24712 raft_consensus.cc:686] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [term 1 LEADER]: Becoming Leader. State: Replica: 96a7463fe0df46ea8b4c6c750b7e79c8, State: Running, Role: LEADER
I20260619 06:41:27.483318 24712 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } } peers { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } } peers { permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } }
I20260619 06:41:27.500356 24739 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96a7463fe0df46ea8b4c6c750b7e79c8. Latest consensus state: current_term: 1 leader_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } } peers { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } } peers { permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } } }
I20260619 06:41:27.500938 24739 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [sys.catalog]: This master's current role is: LEADER
I20260619 06:41:27.512260 24741 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:41:27.514736 24741 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260619 06:41:27.526317 24565 tablet.cc:2369] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:41:27.537824 24660 raft_consensus.cc:1261] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915 [term 1 FOLLOWER]: Refusing update from remote peer 96a7463fe0df46ea8b4c6c750b7e79c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:41:27.538908 24739 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:41:27.546900 24586 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6 [term 1 FOLLOWER]: Refusing update from remote peer 96a7463fe0df46ea8b4c6c750b7e79c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:41:27.548012 24739 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:41:27.582033 24698 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96a7463fe0df46ea8b4c6c750b7e79c8. Latest consensus state: current_term: 1 leader_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } } peers { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } } peers { permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } } }
I20260619 06:41:27.582356 24698 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:41:27.586550 24742 mvcc.cc:205] Tried to move back new op lower bound from 7298462873732616192 to 7298462873563160576. Current Snapshot: MvccSnapshot[applied={T|T < 7298462873732616192}]
I20260619 06:41:27.597713 24726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96a7463fe0df46ea8b4c6c750b7e79c8. Latest consensus state: current_term: 1 leader_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } } peers { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } } peers { permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } } }
I20260619 06:41:27.598197 24726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:41:27.603032 24698 sys_catalog.cc:455] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } } peers { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } } peers { permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } } }
I20260619 06:41:27.603322 24698 sys_catalog.cc:458] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:41:27.603842 24739 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } } peers { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } } peers { permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } } }
I20260619 06:41:27.604151 24739 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [sys.catalog]: This master's current role is: LEADER
I20260619 06:41:27.608822 24741 catalog_manager.cc:1347] Generated new cluster ID: addc7561c62e4dbab80b66ea8c051815
I20260619 06:41:27.608934 24741 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:41:27.631665 24712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } } peers { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } } peers { permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } } }
I20260619 06:41:27.632069 24712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8 [sys.catalog]: This master's current role is: LEADER
I20260619 06:41:27.634897 24744 mvcc.cc:205] Tried to move back new op lower bound from 7298462873732616192 to 7298462873563160576. Current Snapshot: MvccSnapshot[applied={T|T < 7298462873732616192}]
I20260619 06:41:27.647703 24726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96a7463fe0df46ea8b4c6c750b7e79c8" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43363 } } peers { permanent_uuid: "966a73ffa7c849fe9364c6b09bb686a6" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 33003 } } peers { permanent_uuid: "ecbb3c2979174c6b973fb7cae6cd0915" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41639 } } }
I20260619 06:41:27.648022 24726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:41:27.668515 24741 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:41:27.670461 24741 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:41:27.692147 24741 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 96a7463fe0df46ea8b4c6c750b7e79c8: Generated new TSK 0
I20260619 06:41:27.693691 24741 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:41:28.175734 24709 catalog_manager.cc:1259] Loaded cluster ID: addc7561c62e4dbab80b66ea8c051815
I20260619 06:41:28.175835 24709 catalog_manager.cc:1552] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915: loading cluster ID for follower catalog manager: success
I20260619 06:41:28.178300 24709 catalog_manager.cc:1574] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915: acquiring CA information for follower catalog manager: success
I20260619 06:41:28.180240 24709 catalog_manager.cc:1602] T 00000000000000000000000000000000 P ecbb3c2979174c6b973fb7cae6cd0915: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 06:41:28.346896 24737 catalog_manager.cc:1259] Loaded cluster ID: addc7561c62e4dbab80b66ea8c051815
I20260619 06:41:28.347018 24737 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6: loading cluster ID for follower catalog manager: success
I20260619 06:41:28.349682 24737 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6: acquiring CA information for follower catalog manager: success
I20260619 06:41:28.351563 24737 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 966a73ffa7c849fe9364c6b09bb686a6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 06:41:28.802947 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 24470
I20260619 06:41:28.804557 24532 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:28.921056 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 24470
I20260619 06:41:28.942210 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 24544
I20260619 06:41:28.943428 24606 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:29.053437 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 24544
I20260619 06:41:29.073915 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 24618
I20260619 06:41:29.075027 24680 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:29.184293 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 24618
2026-06-19T06:41:29Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (4928 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:41:29 dist-test-slave-7lz4 krb5kdc[24760](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:41:29 dist-test-slave-7lz4 krb5kdc[24760](info): set up 2 sockets
Jun 19 06:41:29 dist-test-slave-7lz4 krb5kdc[24760](info): commencing operation
krb5kdc: starting...
W20260619 06:41:30.292263 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.066s user 0.005s sys 0.019s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:41:30 dist-test-slave-7lz4 krb5kdc[24760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:41:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:41:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:41:30.534577 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:34087
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:44489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:34087
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:41:30.881422 24773 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:30.881750 24773 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:30.881942 24773 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:30.889693 24773 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:41:30.889827 24773 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:30.889935 24773 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:30.890033 24773 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:41:30.890113 24773 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:41:30.900652 24773 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:44489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:34087
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:34087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:30.902136 24773 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:30.903585 24773 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:30.916368 24779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:30.916455 24781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:30.917081 24778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:30.917145 24773 server_base.cc:1034] running on GCE node
I20260619 06:41:30.918057 24773 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:30.919682 24773 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:30.920930 24773 hybrid_clock.cc:648] HybridClock initialized: now 1781851290920868 us; error 51 us; skew 500 ppm
I20260619 06:41:30.921303 24773 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:30 dist-test-slave-7lz4 krb5kdc[24760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851290, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:30.929388 24773 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:41:30.931084 24773 webserver.cc:460] Webserver started at http://127.10.192.126:40969/ using document root <none> and password file <none>
I20260619 06:41:30.932094 24773 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:30.932282 24773 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:30.932624 24773 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:41:30.935839 24773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "112fd09a600b45d6b80499196d35bf23"
format_stamp: "Formatted at 2026-06-19 06:41:30 on dist-test-slave-7lz4"
server_key: "b3561aeb1309ddfc24a39e19062e5ebc"
server_key_iv: "73bc35854d7335370c41ba99f03984c2"
server_key_version: "encryptionkey@0"
I20260619 06:41:30.936651 24773 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "112fd09a600b45d6b80499196d35bf23"
format_stamp: "Formatted at 2026-06-19 06:41:30 on dist-test-slave-7lz4"
server_key: "b3561aeb1309ddfc24a39e19062e5ebc"
server_key_iv: "73bc35854d7335370c41ba99f03984c2"
server_key_version: "encryptionkey@0"
I20260619 06:41:30.942387 24773 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 06:41:30.946126 24788 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:30.947781 24773 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:41:30.947993 24773 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "112fd09a600b45d6b80499196d35bf23"
format_stamp: "Formatted at 2026-06-19 06:41:30 on dist-test-slave-7lz4"
server_key: "b3561aeb1309ddfc24a39e19062e5ebc"
server_key_iv: "73bc35854d7335370c41ba99f03984c2"
server_key_version: "encryptionkey@0"
I20260619 06:41:30.948210 24773 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:30.972568 24773 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:30.977041 24773 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:30.977408 24773 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:30.997203 24773 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:34087
I20260619 06:41:30.997167 24839 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:34087 every 8 connection(s)
I20260619 06:41:30.998723 24773 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:41:31.002599 24840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:41:31.008867 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 24773
I20260619 06:41:31.009109 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:41:31.009755 11009 external_mini_cluster.cc:1428] Setting key 997c30c13923f7d60e89b4332c047496
I20260619 06:41:31.014076 24840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23: Bootstrap starting.
I20260619 06:41:31.018141 24840 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23: Neither blocks nor log segments found. Creating new log.
I20260619 06:41:31.019361 24840 log.cc:824] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:31.022711 24840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23: No bootstrap required, opened a new log
Jun 19 06:41:31 dist-test-slave-7lz4 krb5kdc[24760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851290, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:31.033609 24840 raft_consensus.cc:348] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112fd09a600b45d6b80499196d35bf23" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34087 } }
I20260619 06:41:31.034186 24840 raft_consensus.cc:374] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:41:31.034312 24840 raft_consensus.cc:729] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 112fd09a600b45d6b80499196d35bf23, State: Initialized, Role: FOLLOWER
I20260619 06:41:31.035003 24840 consensus_queue.cc:260] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112fd09a600b45d6b80499196d35bf23" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34087 } }
I20260619 06:41:31.035322 24840 raft_consensus.cc:388] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:41:31.035468 24840 raft_consensus.cc:482] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:41:31.035687 24840 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:41:31.036067 24843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:31.011843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43246 (local address 127.10.192.126:34087)
0619 06:41:31.012680 (+ 837us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:31.012693 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:31.012736 (+ 43us) server_negotiation.cc:407] Connection header received
0619 06:41:31.014616 (+ 1880us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:31.014639 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:31.015056 (+ 417us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:31.015405 (+ 349us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:31.017475 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:31.018975 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:31.020764 (+ 1789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:31.021466 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:31.021608 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:31.026657 (+ 5049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:31.026669 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:31.026696 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:31.026750 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:31.030987 (+ 4237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:31.031877 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:31.031887 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:31.031896 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:31.032132 (+ 236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:31.032508 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:31.032512 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:31.032516 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:31.033291 (+ 775us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:31.033573 (+ 282us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:31.034029 (+ 456us) server_negotiation.cc:299] Negotiation successful
0619 06:41:31.034538 (+ 509us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":393,"threads_started":1}
I20260619 06:41:31.038297 24840 raft_consensus.cc:504] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112fd09a600b45d6b80499196d35bf23" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34087 } }
I20260619 06:41:31.038924 24840 leader_election.cc:302] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 112fd09a600b45d6b80499196d35bf23; no voters:
I20260619 06:41:31.039594 24840 leader_election.cc:288] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:41:31.039788 24845 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:41:31.040247 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:41:31.041980 24840 sys_catalog.cc:564] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:41:31.046737 24845 raft_consensus.cc:686] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23 [term 1 LEADER]: Becoming Leader. State: Replica: 112fd09a600b45d6b80499196d35bf23, State: Running, Role: LEADER
I20260619 06:41:31.047269 24845 consensus_queue.cc:237] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112fd09a600b45d6b80499196d35bf23" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34087 } }
I20260619 06:41:31.050299 24847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 112fd09a600b45d6b80499196d35bf23. Latest consensus state: current_term: 1 leader_uuid: "112fd09a600b45d6b80499196d35bf23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112fd09a600b45d6b80499196d35bf23" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34087 } } }
I20260619 06:41:31.050729 24847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23 [sys.catalog]: This master's current role is: LEADER
I20260619 06:41:31.051031 24846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "112fd09a600b45d6b80499196d35bf23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "112fd09a600b45d6b80499196d35bf23" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34087 } } }
I20260619 06:41:31.051436 24846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23 [sys.catalog]: This master's current role is: LEADER
W20260619 06:41:31.055546 24859 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 06:41:31.055706 24859 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 06:41:31.055845 24860 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:41:31.057729 24860 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:41:31.065960 24860 catalog_manager.cc:1347] Generated new cluster ID: b80f10976fb7499993c21bfd413b18f7
I20260619 06:41:31.066097 24860 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:41:31.083793 24860 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:41:31.085779 24860 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:41:31.101528 24860 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 112fd09a600b45d6b80499196d35bf23: Generated new TSK 0
I20260619 06:41:31.102675 24860 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:41:31.154353 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 24773
I20260619 06:41:31.155671 24835 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:31.256031 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 24773
2026-06-19T06:41:31Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2067 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:41:31 dist-test-slave-7lz4 krb5kdc[24868](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:41:31 dist-test-slave-7lz4 krb5kdc[24868](info): set up 2 sockets
Jun 19 06:41:31 dist-test-slave-7lz4 krb5kdc[24868](info): commencing operation
krb5kdc: starting...
W20260619 06:41:32.356178 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.006s sys 0.017s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:41:32 dist-test-slave-7lz4 krb5kdc[24868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:41:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:41:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:41:32.595760 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:37455
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:42001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:37455
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:41:32.931608 24881 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:32.932057 24881 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:32.932242 24881 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:32.939781 24881 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:41:32.939934 24881 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:32.940038 24881 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:32.940137 24881 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:41:32.940207 24881 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:41:32.951283 24881 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:42001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:37455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:37455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:32.952814 24881 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:32.954223 24881 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:32.966674 24886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:32.966632 24887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:32.966698 24889 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:32.967578 24881 server_base.cc:1034] running on GCE node
I20260619 06:41:32.968443 24881 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:32.969977 24881 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:32.971215 24881 hybrid_clock.cc:648] HybridClock initialized: now 1781851292971157 us; error 45 us; skew 500 ppm
I20260619 06:41:32.971601 24881 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:32 dist-test-slave-7lz4 krb5kdc[24868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851292, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:32.974893 24881 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:41:32.976588 24881 webserver.cc:460] Webserver started at http://127.10.192.126:44119/ using document root <none> and password file <none>
I20260619 06:41:32.977340 24881 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:32.977448 24881 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:32.977707 24881 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:41:32.981511 24881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "410058977e5947beb4aecb1135b1b606"
format_stamp: "Formatted at 2026-06-19 06:41:32 on dist-test-slave-7lz4"
server_key: "681a9ee15a477c83e0a8840a3e8c3718"
server_key_iv: "5c26a34c173f0d553ba9a1a1ecd7882b"
server_key_version: "encryptionkey@0"
I20260619 06:41:32.982306 24881 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "410058977e5947beb4aecb1135b1b606"
format_stamp: "Formatted at 2026-06-19 06:41:32 on dist-test-slave-7lz4"
server_key: "681a9ee15a477c83e0a8840a3e8c3718"
server_key_iv: "5c26a34c173f0d553ba9a1a1ecd7882b"
server_key_version: "encryptionkey@0"
I20260619 06:41:32.988045 24881 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.004s
I20260619 06:41:32.991767 24896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:32.993480 24881 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:41:32.993690 24881 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "410058977e5947beb4aecb1135b1b606"
format_stamp: "Formatted at 2026-06-19 06:41:32 on dist-test-slave-7lz4"
server_key: "681a9ee15a477c83e0a8840a3e8c3718"
server_key_iv: "5c26a34c173f0d553ba9a1a1ecd7882b"
server_key_version: "encryptionkey@0"
I20260619 06:41:32.993914 24881 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:33.012737 24881 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:33.017153 24881 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:33.017460 24881 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:33.036803 24881 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:37455
I20260619 06:41:33.036835 24947 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:37455 every 8 connection(s)
I20260619 06:41:33.038344 24881 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:41:33.042322 24948 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:41:33.048811 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 24881
I20260619 06:41:33.049033 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:41:33.049692 11009 external_mini_cluster.cc:1428] Setting key 4230b4cb706d56a9ca82ae2014a61d32
I20260619 06:41:33.054414 24948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606: Bootstrap starting.
I20260619 06:41:33.058511 24948 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606: Neither blocks nor log segments found. Creating new log.
I20260619 06:41:33.059851 24948 log.cc:824] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:33.063310 24948 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606: No bootstrap required, opened a new log
Jun 19 06:41:33 dist-test-slave-7lz4 krb5kdc[24868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:33.073740 24948 raft_consensus.cc:348] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "410058977e5947beb4aecb1135b1b606" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37455 } }
I20260619 06:41:33.074272 24948 raft_consensus.cc:374] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:41:33.074404 24948 raft_consensus.cc:729] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 410058977e5947beb4aecb1135b1b606, State: Initialized, Role: FOLLOWER
I20260619 06:41:33.075148 24948 consensus_queue.cc:260] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "410058977e5947beb4aecb1135b1b606" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37455 } }
I20260619 06:41:33.075412 24948 raft_consensus.cc:388] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:41:33.075588 24948 raft_consensus.cc:482] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:41:33.075798 24948 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:41:33.076411 24951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:33.051973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40302 (local address 127.10.192.126:37455)
0619 06:41:33.052804 (+ 831us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:33.052823 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:33.052878 (+ 55us) server_negotiation.cc:407] Connection header received
0619 06:41:33.055319 (+ 2441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:33.055350 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:33.055916 (+ 566us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:33.056429 (+ 513us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:33.057799 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:33.059849 (+ 2050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:33.061633 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:33.062688 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:33.062888 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:33.067192 (+ 4304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:33.067203 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:33.067225 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:33.067274 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:33.071679 (+ 4405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:33.072442 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:33.072453 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:33.072468 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:33.072696 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:33.073062 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:33.073066 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:33.073069 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:33.073849 (+ 780us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:33.074144 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:33.074591 (+ 447us) server_negotiation.cc:299] Negotiation successful
0619 06:41:33.075033 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":566,"thread_start_us":339,"threads_started":1}
I20260619 06:41:33.078301 24948 raft_consensus.cc:504] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "410058977e5947beb4aecb1135b1b606" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37455 } }
I20260619 06:41:33.078835 24948 leader_election.cc:302] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 410058977e5947beb4aecb1135b1b606; no voters:
I20260619 06:41:33.079525 24948 leader_election.cc:288] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:41:33.079594 24953 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:41:33.080384 24953 raft_consensus.cc:686] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 1 LEADER]: Becoming Leader. State: Replica: 410058977e5947beb4aecb1135b1b606, State: Running, Role: LEADER
I20260619 06:41:33.080947 24953 consensus_queue.cc:237] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "410058977e5947beb4aecb1135b1b606" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37455 } }
I20260619 06:41:33.081684 24948 sys_catalog.cc:564] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:41:33.083455 24954 sys_catalog.cc:455] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "410058977e5947beb4aecb1135b1b606" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "410058977e5947beb4aecb1135b1b606" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37455 } } }
I20260619 06:41:33.083899 24954 sys_catalog.cc:458] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [sys.catalog]: This master's current role is: LEADER
I20260619 06:41:33.083832 24955 sys_catalog.cc:455] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 410058977e5947beb4aecb1135b1b606. Latest consensus state: current_term: 1 leader_uuid: "410058977e5947beb4aecb1135b1b606" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "410058977e5947beb4aecb1135b1b606" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37455 } } }
I20260619 06:41:33.084128 24955 sys_catalog.cc:458] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [sys.catalog]: This master's current role is: LEADER
I20260619 06:41:33.086442 24959 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:41:33.092633 24959 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:41:33.103734 24959 catalog_manager.cc:1347] Generated new cluster ID: c190ba971e564c9299cbabe65373aef6
I20260619 06:41:33.103875 24959 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:41:33.118360 24959 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:41:33.120321 24959 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:41:33.130134 24959 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606: Generated new TSK 0
I20260619 06:41:33.131287 24959 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
I20260619 06:41:33.190857 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:37455
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:42001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:41:33.535252 24974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:33.535552 24974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:33.535732 24974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:33.543215 24974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:33.543341 24974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:33.543524 24974 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:41:33.553587 24974 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:42001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:37455
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:33.554967 24974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:33.556372 24974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:33.570128 24979 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:33.570096 24982 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:33.570061 24980 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:33.570870 24974 server_base.cc:1034] running on GCE node
I20260619 06:41:33.571480 24974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:33.572486 24974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:33.573686 24974 hybrid_clock.cc:648] HybridClock initialized: now 1781851293573628 us; error 63 us; skew 500 ppm
I20260619 06:41:33.574009 24974 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:33 dist-test-slave-7lz4 krb5kdc[24868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851293, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:33.580930 24974 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:41:33.582697 24974 webserver.cc:460] Webserver started at http://127.10.192.65:40037/ using document root <none> and password file <none>
I20260619 06:41:33.583421 24974 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:33.583564 24974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:33.583905 24974 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:41:33.586918 24974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "a0d586be9de2419aad183a8ad50eb443"
format_stamp: "Formatted at 2026-06-19 06:41:33 on dist-test-slave-7lz4"
server_key: "76ee77cf46d4fb0ff7e051c4ddb51578"
server_key_iv: "22a736aa67511f8f3874819119ff7160"
server_key_version: "encryptionkey@0"
I20260619 06:41:33.587833 24974 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "a0d586be9de2419aad183a8ad50eb443"
format_stamp: "Formatted at 2026-06-19 06:41:33 on dist-test-slave-7lz4"
server_key: "76ee77cf46d4fb0ff7e051c4ddb51578"
server_key_iv: "22a736aa67511f8f3874819119ff7160"
server_key_version: "encryptionkey@0"
I20260619 06:41:33.593665 24974 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 06:41:33.597431 24989 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:33.598994 24974 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 06:41:33.599184 24974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "a0d586be9de2419aad183a8ad50eb443"
format_stamp: "Formatted at 2026-06-19 06:41:33 on dist-test-slave-7lz4"
server_key: "76ee77cf46d4fb0ff7e051c4ddb51578"
server_key_iv: "22a736aa67511f8f3874819119ff7160"
server_key_version: "encryptionkey@0"
I20260619 06:41:33.599400 24974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:33.621114 24974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:33.625329 24974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:33.625643 24974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:33.626677 24974 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:41:33.628118 24974 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:41:33.628219 24974 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:33.628368 24974 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:41:33.628438 24974 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:33.662640 24974 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:43121
I20260619 06:41:33.662695 25101 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:43121 every 8 connection(s)
I20260619 06:41:33.664031 24974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:41:33.667109 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 24974
I20260619 06:41:33.667333 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:41:33.668040 11009 external_mini_cluster.cc:1428] Setting key 5cc45de56cfed125ddca7beef79f3f52
Jun 19 06:41:33 dist-test-slave-7lz4 krb5kdc[24868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851293, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:33.691129 25104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:33.666686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:40805 (local address 127.10.192.126:37455)
0619 06:41:33.667250 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:33.667259 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:33.668462 (+ 1203us) server_negotiation.cc:407] Connection header received
0619 06:41:33.670563 (+ 2101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:33.670570 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:33.670678 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:33.670805 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:33.672365 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:33.673523 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:33.676123 (+ 2600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:33.677245 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:33.677403 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:33.683528 (+ 6125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:33.683536 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:33.683541 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:33.683599 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:33.686828 (+ 3229us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:33.688005 (+ 1177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:33.688012 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:33.688016 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:33.688229 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:33.688858 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:33.688863 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:33.688867 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:33.689255 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:33.689444 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:33.690477 (+ 1033us) server_negotiation.cc:299] Negotiation successful
0619 06:41:33.690737 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":266,"threads_started":1}
I20260619 06:41:33.692479 25105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:33.667405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:40805)
0619 06:41:33.668282 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:33.668328 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:33.670289 (+ 1961us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:33.671008 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:33.671016 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:33.671533 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:33.672190 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:33.672210 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:33.673685 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:33.673689 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:33.675931 (+ 2242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:33.675948 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:33.677530 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:33.677541 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:33.677907 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:33.679716 (+ 1809us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:33.679760 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:33.683203 (+ 3443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:33.686996 (+ 3793us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:33.687006 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:33.687027 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:33.687807 (+ 780us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:33.688393 (+ 586us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:33.688415 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:33.688418 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:33.688728 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:33.689397 (+ 669us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:33.689406 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:33.689977 (+ 571us) client_negotiation.cc:769] Sending connection context
0619 06:41:33.690349 (+ 372us) client_negotiation.cc:240] Negotiation successful
0619 06:41:33.690942 (+ 593us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"thread_start_us":376,"threads_started":1}
I20260619 06:41:33.694432 25102 heartbeater.cc:347] Connected to a master server at 127.10.192.126:37455
I20260619 06:41:33.694816 25102 heartbeater.cc:464] Registering TS with master...
I20260619 06:41:33.695850 25102 heartbeater.cc:511] Master 127.10.192.126:37455 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.192.66@KRBTEST.COM; defaulting to no policy
I20260619 06:41:33.698840 24913 ts_manager.cc:194] Registered new tserver with Master: a0d586be9de2419aad183a8ad50eb443 (127.10.192.65:43121)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.66@KRBTEST.COM" created.
I20260619 06:41:33.701076 24913 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:40805
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
I20260619 06:41:33.737113 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:37455
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:42001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:41:34.074460 25108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:34.074816 25108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:34.074990 25108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:34.082772 25108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:34.082930 25108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:34.083106 25108 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:41:34.093632 25108 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:42001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:37455
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:34.095083 25108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:34.096517 25108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:34.110711 25113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:34.110872 25116 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:34.110837 25114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:34.111598 25108 server_base.cc:1034] running on GCE node
I20260619 06:41:34.112311 25108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:34.113296 25108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:34.114521 25108 hybrid_clock.cc:648] HybridClock initialized: now 1781851294114467 us; error 37 us; skew 500 ppm
I20260619 06:41:34.114892 25108 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:34 dist-test-slave-7lz4 krb5kdc[24868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851294, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:34.118220 25108 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:41:34.119899 25108 webserver.cc:460] Webserver started at http://127.10.192.66:44977/ using document root <none> and password file <none>
I20260619 06:41:34.120630 25108 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:34.120782 25108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:34.121104 25108 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:41:34.124272 25108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "402ad02707c8406ea10588a5ef7a254c"
format_stamp: "Formatted at 2026-06-19 06:41:34 on dist-test-slave-7lz4"
server_key: "b844f28660d1c9824e324c2706de4c81"
server_key_iv: "3a678d1cb4cf6fedbde71a0d9a161882"
server_key_version: "encryptionkey@0"
I20260619 06:41:34.125090 25108 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "402ad02707c8406ea10588a5ef7a254c"
format_stamp: "Formatted at 2026-06-19 06:41:34 on dist-test-slave-7lz4"
server_key: "b844f28660d1c9824e324c2706de4c81"
server_key_iv: "3a678d1cb4cf6fedbde71a0d9a161882"
server_key_version: "encryptionkey@0"
I20260619 06:41:34.130527 25108 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260619 06:41:34.134285 25123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:34.135998 25108 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260619 06:41:34.136195 25108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "402ad02707c8406ea10588a5ef7a254c"
format_stamp: "Formatted at 2026-06-19 06:41:34 on dist-test-slave-7lz4"
server_key: "b844f28660d1c9824e324c2706de4c81"
server_key_iv: "3a678d1cb4cf6fedbde71a0d9a161882"
server_key_version: "encryptionkey@0"
I20260619 06:41:34.136409 25108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:34.157850 25108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:34.162348 25108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:34.162657 25108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:34.163872 25108 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:41:34.165409 25108 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:41:34.165510 25108 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:34.165657 25108 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:41:34.165727 25108 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:34.199512 25108 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:33421
I20260619 06:41:34.199548 25235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:33421 every 8 connection(s)
I20260619 06:41:34.200901 25108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:41:34.210848 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 25108
I20260619 06:41:34.211033 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:41:34.211512 11009 external_mini_cluster.cc:1428] Setting key 926ed8ac4afbe3a86418660d2cf466ab
Jun 19 06:41:34 dist-test-slave-7lz4 krb5kdc[24868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851294, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:34.222069 25238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:34.203701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:33485 (local address 127.10.192.126:37455)
0619 06:41:34.204212 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:34.204217 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:34.205269 (+ 1052us) server_negotiation.cc:407] Connection header received
0619 06:41:34.207139 (+ 1870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:34.207145 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:34.207245 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:34.207366 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:34.208980 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.209709 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.211400 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.211922 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.212053 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:34.216050 (+ 3997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:34.216055 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:34.216059 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:34.216094 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:34.218794 (+ 2700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:34.219615 (+ 821us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:34.219619 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:34.219622 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:34.219811 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:34.220251 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:34.220257 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:34.220260 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:34.220550 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:34.220703 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:34.221445 (+ 742us) server_negotiation.cc:299] Negotiation successful
0619 06:41:34.221684 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":247,"threads_started":1}
I20260619 06:41:34.223105 25239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:34.204376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:33485)
0619 06:41:34.205089 (+ 713us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:34.205128 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:34.206849 (+ 1721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:34.207622 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:34.207671 (+ 49us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:34.208218 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:34.208803 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:34.208820 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.209868 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.209872 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:34.211262 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:34.211274 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.212158 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.212166 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:34.212476 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:34.213196 (+ 720us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:34.213225 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:34.215804 (+ 2579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:34.218971 (+ 3167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:34.218981 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:34.219001 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:34.219476 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:34.219926 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:34.219931 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:34.219935 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:34.220131 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:34.220679 (+ 548us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:34.220688 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:34.221056 (+ 368us) client_negotiation.cc:769] Sending connection context
0619 06:41:34.221340 (+ 284us) client_negotiation.cc:240] Negotiation successful
0619 06:41:34.221924 (+ 584us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":279,"threads_started":1}
I20260619 06:41:34.224696 25236 heartbeater.cc:347] Connected to a master server at 127.10.192.126:37455
I20260619 06:41:34.225044 25236 heartbeater.cc:464] Registering TS with master...
I20260619 06:41:34.225992 25236 heartbeater.cc:511] Master 127.10.192.126:37455 requested a full tablet report, sending...
I20260619 06:41:34.227731 24913 ts_manager.cc:194] Registered new tserver with Master: 402ad02707c8406ea10588a5ef7a254c (127.10.192.66:33421)
I20260619 06:41:34.229025 24913 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:33485
WARNING: no policy specified for kudu/127.10.192.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
I20260619 06:41:34.263433 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:37455
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:42001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:41:34.606887 25242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:34.607209 25242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:34.607362 25242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:34.614856 25242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:34.614976 25242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:34.615176 25242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:41:34.625350 25242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:42001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:37455
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:34.626715 25242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:34.628104 25242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:34.641909 25247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:34.641958 25248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:34.641871 25250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:34.643247 25242 server_base.cc:1034] running on GCE node
I20260619 06:41:34.643949 25242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:34.644964 25242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:34.646216 25242 hybrid_clock.cc:648] HybridClock initialized: now 1781851294646142 us; error 81 us; skew 500 ppm
I20260619 06:41:34.646544 25242 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:34 dist-test-slave-7lz4 krb5kdc[24868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851294, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:34.649802 25242 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:41:34.651340 25242 webserver.cc:460] Webserver started at http://127.10.192.67:33471/ using document root <none> and password file <none>
I20260619 06:41:34.652117 25242 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:34.652261 25242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:34.652566 25242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:41:34.655706 25242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "f819cb11dd424c299e25363ca5c6416b"
format_stamp: "Formatted at 2026-06-19 06:41:34 on dist-test-slave-7lz4"
server_key: "73b8b984464f1013725cf82e1fa4137e"
server_key_iv: "46b777cb677a4b0876c1eac2ac2a2db8"
server_key_version: "encryptionkey@0"
I20260619 06:41:34.656534 25242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "f819cb11dd424c299e25363ca5c6416b"
format_stamp: "Formatted at 2026-06-19 06:41:34 on dist-test-slave-7lz4"
server_key: "73b8b984464f1013725cf82e1fa4137e"
server_key_iv: "46b777cb677a4b0876c1eac2ac2a2db8"
server_key_version: "encryptionkey@0"
I20260619 06:41:34.661823 25242 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260619 06:41:34.665575 25257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:34.667119 25242 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 06:41:34.667294 25242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "f819cb11dd424c299e25363ca5c6416b"
format_stamp: "Formatted at 2026-06-19 06:41:34 on dist-test-slave-7lz4"
server_key: "73b8b984464f1013725cf82e1fa4137e"
server_key_iv: "46b777cb677a4b0876c1eac2ac2a2db8"
server_key_version: "encryptionkey@0"
I20260619 06:41:34.667498 25242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:34.683166 25242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:34.687830 25242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:34.688130 25242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:34.689218 25242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:41:34.690716 25242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:41:34.690820 25242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:34.690965 25242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:41:34.691037 25242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:34.709317 25102 heartbeater.cc:503] Master 127.10.192.126:37455 was elected leader, sending a full tablet report...
I20260619 06:41:34.736939 25242 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:34481
I20260619 06:41:34.736958 25369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:34481 every 8 connection(s)
I20260619 06:41:34.738538 25242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:41:34.739885 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 25242
I20260619 06:41:34.740097 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:41:34.740710 11009 external_mini_cluster.cc:1428] Setting key 599293ae6c653a395876d204358e3954
Jun 19 06:41:34 dist-test-slave-7lz4 krb5kdc[24868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851294, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:34.761797 25372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:34.741964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:45563 (local address 127.10.192.126:37455)
0619 06:41:34.742640 (+ 676us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:34.742647 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:34.743807 (+ 1160us) server_negotiation.cc:407] Connection header received
0619 06:41:34.746082 (+ 2275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:34.746088 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:34.746190 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:34.746332 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:34.748177 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.749126 (+ 949us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.750929 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.751385 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.751532 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:34.755774 (+ 4242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:34.755786 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:34.755791 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:34.755831 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:34.758824 (+ 2993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:34.759609 (+ 785us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:34.759614 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:34.759617 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:34.759804 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:34.760216 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:34.760219 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:34.760221 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:34.760495 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:34.760615 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:34.761340 (+ 725us) server_negotiation.cc:299] Negotiation successful
0619 06:41:34.761524 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":349,"threads_started":1}
I20260619 06:41:34.762887 25373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:34.742686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:45563)
0619 06:41:34.743602 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:34.743701 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:34.745771 (+ 2070us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:34.746622 (+ 851us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:34.746632 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:34.747231 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:34.747980 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:34.748001 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.749322 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.749327 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:34.750761 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:34.750777 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.751694 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.751704 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:34.751974 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:34.752751 (+ 777us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:34.752779 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:34.755485 (+ 2706us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:34.758991 (+ 3506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:34.758999 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:34.759015 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:34.759495 (+ 480us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:34.759898 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:34.759901 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:34.759904 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:34.760098 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:34.760594 (+ 496us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:34.760604 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:34.760961 (+ 357us) client_negotiation.cc:769] Sending connection context
0619 06:41:34.761229 (+ 268us) client_negotiation.cc:240] Negotiation successful
0619 06:41:34.761701 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":659,"thread_start_us":376,"threads_started":1}
I20260619 06:41:34.764488 25370 heartbeater.cc:347] Connected to a master server at 127.10.192.126:37455
I20260619 06:41:34.764832 25370 heartbeater.cc:464] Registering TS with master...
I20260619 06:41:34.765633 25370 heartbeater.cc:511] Master 127.10.192.126:37455 requested a full tablet report, sending...
I20260619 06:41:34.767211 24913 ts_manager.cc:194] Registered new tserver with Master: f819cb11dd424c299e25363ca5c6416b (127.10.192.67:34481)
I20260619 06:41:34.768399 24913 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:45563
I20260619 06:41:34.769708 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 06:41:34.787212 25372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:34.774709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36096 (local address 127.10.192.126:37455)
0619 06:41:34.774881 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:34.774886 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:34.775326 (+ 440us) server_negotiation.cc:407] Connection header received
0619 06:41:34.775470 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:34.775474 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:34.775539 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:34.775623 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:34.777088 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.777835 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.779202 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.779595 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.779767 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:34.782143 (+ 2376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:34.782147 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:34.782151 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:34.782182 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:34.784962 (+ 2780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:34.785619 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:34.785623 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:34.785625 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:34.785740 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:34.786038 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:34.786041 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:34.786043 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:34.786361 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:34.786536 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:34.786817 (+ 281us) server_negotiation.cc:299] Negotiation successful
0619 06:41:34.786985 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260619 06:41:34.791441 24913 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36096:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:41:34.798435 24913 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:41:34.829299 25386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:34.811989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:34481 (local address 127.0.0.1:48652)
0619 06:41:34.819902 (+ 7913us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:34.819923 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:34.820065 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:34.821037 (+ 972us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:34.821048 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:34.821083 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:34.821512 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:34.821527 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.823525 (+ 1998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.823530 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:34.825862 (+ 2332us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:34.825884 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.828181 (+ 2297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.828188 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:34.828404 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:34.828463 (+ 59us) client_negotiation.cc:769] Sending connection context
0619 06:41:34.828615 (+ 152us) client_negotiation.cc:240] Negotiation successful
0619 06:41:34.828826 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7770,"mutex_wait_us":2,"thread_start_us":9928,"threads_started":1}
I20260619 06:41:34.829465 25383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:34.811292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:43121 (local address 127.0.0.1:51732)
0619 06:41:34.812167 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:34.812221 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:34.812455 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:34.822452 (+ 9997us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:34.822459 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:34.822486 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:34.822851 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:34.822868 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.824899 (+ 2031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.824905 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:34.826753 (+ 1848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:34.826767 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.828585 (+ 1818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.828599 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:34.828778 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:34.828822 (+ 44us) client_negotiation.cc:769] Sending connection context
0619 06:41:34.828928 (+ 106us) client_negotiation.cc:240] Negotiation successful
0619 06:41:34.829069 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":506,"thread_start_us":298,"threads_started":1}
I20260619 06:41:34.829902 25384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:34.811473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51732 (local address 127.10.192.65:43121)
0619 06:41:34.821788 (+ 10315us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:34.821796 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:34.821829 (+ 33us) server_negotiation.cc:407] Connection header received
0619 06:41:34.821931 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:34.821938 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:34.822217 (+ 279us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:34.822465 (+ 248us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:34.823086 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.824749 (+ 1663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.826946 (+ 2197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.828364 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.828526 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:34.828769 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:34.828978 (+ 209us) server_negotiation.cc:299] Negotiation successful
0619 06:41:34.829174 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10124,"thread_start_us":9961,"threads_started":1}
I20260619 06:41:34.830353 25387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:34.812518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48652 (local address 127.10.192.67:34481)
0619 06:41:34.819092 (+ 6574us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:34.819106 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:34.820249 (+ 1143us) server_negotiation.cc:407] Connection header received
0619 06:41:34.820375 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:34.820383 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:34.820729 (+ 346us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:34.820959 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:34.821741 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.823365 (+ 1624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.826065 (+ 2700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.827606 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.827780 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:34.828049 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:34.829785 (+ 1736us) server_negotiation.cc:299] Negotiation successful
0619 06:41:34.829987 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6310,"thread_start_us":6110,"threads_started":1}
I20260619 06:41:34.830775 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:34.813023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46120 (local address 127.10.192.66:33421)
0619 06:41:34.819364 (+ 6341us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:34.819376 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:34.822336 (+ 2960us) server_negotiation.cc:407] Connection header received
0619 06:41:34.822565 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:34.822576 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:34.822828 (+ 252us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:34.823015 (+ 187us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:34.824126 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.825383 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.827873 (+ 2490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.829365 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.829494 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:34.829712 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:34.830287 (+ 575us) server_negotiation.cc:299] Negotiation successful
0619 06:41:34.830469 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6160,"thread_start_us":6043,"threads_started":1}
I20260619 06:41:34.831544 25385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:34.812460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:33421 (local address 127.0.0.1:46120)
0619 06:41:34.822194 (+ 9734us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:34.822217 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:34.822366 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:34.823300 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:34.823306 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:34.823337 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:34.823922 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:34.823936 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.825539 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.825542 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:34.827692 (+ 2150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:34.827709 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.829892 (+ 2183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.829898 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:34.830059 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:34.830101 (+ 42us) client_negotiation.cc:769] Sending connection context
0619 06:41:34.831003 (+ 902us) client_negotiation.cc:240] Negotiation successful
0619 06:41:34.831184 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9592,"mutex_wait_us":62,"thread_start_us":7128,"threads_started":1}
I20260619 06:41:34.833967 25305 tablet_service.cc:1467] Processing CreateTablet for tablet 669d856c58ba476da127e3124b1a2856 (DEFAULT_TABLE table=test-table [id=e1b1a6d4c7754c029e6a985b4f7b865b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:41:34.833973 25037 tablet_service.cc:1467] Processing CreateTablet for tablet 669d856c58ba476da127e3124b1a2856 (DEFAULT_TABLE table=test-table [id=e1b1a6d4c7754c029e6a985b4f7b865b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:41:34.835340 25037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 669d856c58ba476da127e3124b1a2856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:41:34.835355 25305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 669d856c58ba476da127e3124b1a2856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:41:34.835608 25171 tablet_service.cc:1467] Processing CreateTablet for tablet 669d856c58ba476da127e3124b1a2856 (DEFAULT_TABLE table=test-table [id=e1b1a6d4c7754c029e6a985b4f7b865b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:41:34.837249 25171 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 669d856c58ba476da127e3124b1a2856. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:41:34.847569 25389 tablet_bootstrap.cc:492] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b: Bootstrap starting.
I20260619 06:41:34.851564 25390 tablet_bootstrap.cc:492] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443: Bootstrap starting.
I20260619 06:41:34.852249 25389 tablet_bootstrap.cc:654] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b: Neither blocks nor log segments found. Creating new log.
I20260619 06:41:34.853552 25391 tablet_bootstrap.cc:492] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c: Bootstrap starting.
I20260619 06:41:34.853677 25389 log.cc:824] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:34.855587 25390 tablet_bootstrap.cc:654] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443: Neither blocks nor log segments found. Creating new log.
I20260619 06:41:34.856990 25390 log.cc:824] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:34.857275 25391 tablet_bootstrap.cc:654] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c: Neither blocks nor log segments found. Creating new log.
I20260619 06:41:34.857817 25389 tablet_bootstrap.cc:492] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b: No bootstrap required, opened a new log
I20260619 06:41:34.858114 25389 ts_tablet_manager.cc:1397] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.000s
I20260619 06:41:34.858763 25391 log.cc:824] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:34.860571 25390 tablet_bootstrap.cc:492] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443: No bootstrap required, opened a new log
I20260619 06:41:34.860859 25390 ts_tablet_manager.cc:1397] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.001s
I20260619 06:41:34.878496 25391 tablet_bootstrap.cc:492] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c: No bootstrap required, opened a new log
I20260619 06:41:34.878895 25391 ts_tablet_manager.cc:1397] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c: Time spent bootstrapping tablet: real 0.026s user 0.012s sys 0.000s
I20260619 06:41:34.878572 25389 raft_consensus.cc:348] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } } peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } }
I20260619 06:41:34.879392 25389 raft_consensus.cc:374] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:41:34.879540 25389 raft_consensus.cc:729] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f819cb11dd424c299e25363ca5c6416b, State: Initialized, Role: FOLLOWER
I20260619 06:41:34.880402 25389 consensus_queue.cc:260] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } } peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } }
I20260619 06:41:34.882829 25390 raft_consensus.cc:348] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } } peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } }
I20260619 06:41:34.883492 25390 raft_consensus.cc:374] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:41:34.883620 25390 raft_consensus.cc:729] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0d586be9de2419aad183a8ad50eb443, State: Initialized, Role: FOLLOWER
I20260619 06:41:34.884529 25390 consensus_queue.cc:260] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } } peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } }
I20260619 06:41:34.894168 25391 raft_consensus.cc:348] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } } peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } }
I20260619 06:41:34.894840 25391 raft_consensus.cc:374] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:41:34.895009 25391 raft_consensus.cc:729] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402ad02707c8406ea10588a5ef7a254c, State: Initialized, Role: FOLLOWER
I20260619 06:41:34.896070 25391 consensus_queue.cc:260] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } } peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } }
I20260619 06:41:34.896510 25370 heartbeater.cc:503] Master 127.10.192.126:37455 was elected leader, sending a full tablet report...
I20260619 06:41:34.897886 25389 ts_tablet_manager.cc:1428] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b: Time spent starting tablet: real 0.040s user 0.014s sys 0.017s
I20260619 06:41:34.901388 25390 ts_tablet_manager.cc:1428] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443: Time spent starting tablet: real 0.040s user 0.010s sys 0.018s
I20260619 06:41:34.904495 25236 heartbeater.cc:503] Master 127.10.192.126:37455 was elected leader, sending a full tablet report...
I20260619 06:41:34.905404 25391 ts_tablet_manager.cc:1428] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c: Time spent starting tablet: real 0.026s user 0.021s sys 0.004s
I20260619 06:41:34.909619 25395 raft_consensus.cc:482] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:41:34.909986 25395 raft_consensus.cc:504] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } } peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } }
I20260619 06:41:34.911880 25395 leader_election.cc:288] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a0d586be9de2419aad183a8ad50eb443 (127.10.192.65:43121), 402ad02707c8406ea10588a5ef7a254c (127.10.192.66:33421)
W20260619 06:41:34.916533 25103 tablet.cc:2369] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:41:34.919206 25384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:34.912295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:55085 (local address 127.10.192.65:43121)
0619 06:41:34.912626 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:34.912635 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:34.912668 (+ 33us) server_negotiation.cc:407] Connection header received
0619 06:41:34.912751 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:34.912758 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:34.912849 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:34.912964 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:34.913391 (+ 427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.914696 (+ 1305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.917064 (+ 2368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.918197 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.918386 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:34.918471 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:34.918799 (+ 328us) server_negotiation.cc:299] Negotiation successful
0619 06:41:34.918934 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160}
I20260619 06:41:34.919238 25373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:34.912051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:43121 (local address 127.10.192.67:55085)
0619 06:41:34.912234 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:34.912258 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:34.912387 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:34.912998 (+ 611us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:34.913004 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:34.913039 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:34.913230 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:34.913243 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.914843 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.914848 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:34.916837 (+ 1989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:34.916854 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.918367 (+ 1513us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.918374 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:34.918611 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:34.918644 (+ 33us) client_negotiation.cc:769] Sending connection context
0619 06:41:34.918771 (+ 127us) client_negotiation.cc:240] Negotiation successful
0619 06:41:34.918915 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":5}
I20260619 06:41:34.920374 25057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "669d856c58ba476da127e3124b1a2856" candidate_uuid: "f819cb11dd424c299e25363ca5c6416b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0d586be9de2419aad183a8ad50eb443" is_pre_election: true
I20260619 06:41:34.920914 25057 raft_consensus.cc:2454] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f819cb11dd424c299e25363ca5c6416b in term 0.
I20260619 06:41:34.921686 25259 leader_election.cc:302] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0d586be9de2419aad183a8ad50eb443, f819cb11dd424c299e25363ca5c6416b; no voters:
I20260619 06:41:34.922191 25395 raft_consensus.cc:2781] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:41:34.922309 25395 raft_consensus.cc:482] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:41:34.922379 25395 raft_consensus.cc:3037] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:41:34.922441 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:34.913347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:37001 (local address 127.10.192.66:33421)
0619 06:41:34.913560 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:34.913566 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:34.913710 (+ 144us) server_negotiation.cc:407] Connection header received
0619 06:41:34.913905 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:34.913911 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:34.913984 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:34.914086 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:34.914638 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.915778 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.918910 (+ 3132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.920465 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.920636 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:34.921176 (+ 540us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:34.921915 (+ 739us) server_negotiation.cc:299] Negotiation successful
0619 06:41:34.922106 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 06:41:34.923384 25398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:34.912460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:33421 (local address 127.10.192.67:37001)
0619 06:41:34.913610 (+ 1150us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:34.913633 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:34.913770 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:34.914111 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:34.914115 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:34.914141 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:34.914481 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:34.914490 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.915948 (+ 1458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.915956 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:34.918682 (+ 2726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:34.918711 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.921383 (+ 2672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.921391 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:34.921681 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:34.921731 (+ 50us) client_negotiation.cc:769] Sending connection context
0619 06:41:34.922633 (+ 902us) client_negotiation.cc:240] Negotiation successful
0619 06:41:34.922840 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1012,"mutex_wait_us":8,"thread_start_us":379,"threads_started":1}
I20260619 06:41:34.924480 25191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "669d856c58ba476da127e3124b1a2856" candidate_uuid: "f819cb11dd424c299e25363ca5c6416b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402ad02707c8406ea10588a5ef7a254c" is_pre_election: true
I20260619 06:41:34.925098 25191 raft_consensus.cc:2454] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f819cb11dd424c299e25363ca5c6416b in term 0.
I20260619 06:41:34.925685 25395 raft_consensus.cc:504] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } } peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } }
I20260619 06:41:34.926462 25395 leader_election.cc:288] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [CANDIDATE]: Term 1 election: Requested vote from peers a0d586be9de2419aad183a8ad50eb443 (127.10.192.65:43121), 402ad02707c8406ea10588a5ef7a254c (127.10.192.66:33421)
I20260619 06:41:34.926996 25057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "669d856c58ba476da127e3124b1a2856" candidate_uuid: "f819cb11dd424c299e25363ca5c6416b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a0d586be9de2419aad183a8ad50eb443"
I20260619 06:41:34.927103 25191 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "669d856c58ba476da127e3124b1a2856" candidate_uuid: "f819cb11dd424c299e25363ca5c6416b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402ad02707c8406ea10588a5ef7a254c"
I20260619 06:41:34.927241 25057 raft_consensus.cc:3037] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:41:34.927362 25191 raft_consensus.cc:3037] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:41:34.929915 25057 raft_consensus.cc:2454] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f819cb11dd424c299e25363ca5c6416b in term 1.
I20260619 06:41:34.930363 25259 leader_election.cc:302] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a0d586be9de2419aad183a8ad50eb443, f819cb11dd424c299e25363ca5c6416b; no voters:
I20260619 06:41:34.930711 25395 raft_consensus.cc:2781] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:41:34.931288 25395 raft_consensus.cc:686] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [term 1 LEADER]: Becoming Leader. State: Replica: f819cb11dd424c299e25363ca5c6416b, State: Running, Role: LEADER
I20260619 06:41:34.931293 25191 raft_consensus.cc:2454] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f819cb11dd424c299e25363ca5c6416b in term 1.
I20260619 06:41:34.932150 25395 consensus_queue.cc:237] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } } peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } }
I20260619 06:41:34.937929 24912 catalog_manager.cc:5495] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b reported cstate change: term changed from 0 to 1, leader changed from <none> to f819cb11dd424c299e25363ca5c6416b (127.10.192.67). New cstate: current_term: 1 leader_uuid: "f819cb11dd424c299e25363ca5c6416b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } health_report { overall_health: HEALTHY } } }
W20260619 06:41:34.952893 25237 tablet.cc:2369] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:41:34.962716 25387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:34.957162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48660 (local address 127.10.192.67:34481)
0619 06:41:34.957375 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:34.957382 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:34.957460 (+ 78us) server_negotiation.cc:407] Connection header received
0619 06:41:34.957697 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:34.957701 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:34.957813 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:34.957967 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:41:34.958348 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.959065 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.960563 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:34.960968 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:34.961091 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:34.961600 (+ 509us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:41:34.962130 (+ 530us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:41:34.962312 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:34.962365 (+ 53us) server_negotiation.cc:299] Negotiation successful
0619 06:41:34.962448 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260619 06:41:34.974404 25191 raft_consensus.cc:1261] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c [term 1 FOLLOWER]: Refusing update from remote peer f819cb11dd424c299e25363ca5c6416b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:41:34.974409 25057 raft_consensus.cc:1261] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443 [term 1 FOLLOWER]: Refusing update from remote peer f819cb11dd424c299e25363ca5c6416b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:41:34.975533 25399 consensus_queue.cc:1035] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:41:34.976022 25395 consensus_queue.cc:1035] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [LEADER]: Connected to new peer: Peer: permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260619 06:41:34.990327 25371 tablet.cc:2369] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:41:34.990722 25402 mvcc.cc:205] Tried to move back new op lower bound from 7298462904201711616 to 7298462904046653440. Current Snapshot: MvccSnapshot[applied={T|T < 7298462904201711616}]
I20260619 06:41:35.006870 25404 mvcc.cc:205] Tried to move back new op lower bound from 7298462904201711616 to 7298462904046653440. Current Snapshot: MvccSnapshot[applied={T|T < 7298462904201711616}]
I20260619 06:41:35.017251 24911 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:41:35.017678 24911 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36096:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:41:35.023211 24911 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606: Sending DeleteTablet for 3 replicas of tablet 669d856c58ba476da127e3124b1a2856
I20260619 06:41:35.024807 25305 tablet_service.cc:1514] Processing DeleteTablet for tablet 669d856c58ba476da127e3124b1a2856 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:41:35 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:48652
I20260619 06:41:35.025040 25037 tablet_service.cc:1514] Processing DeleteTablet for tablet 669d856c58ba476da127e3124b1a2856 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:41:35 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:51732
I20260619 06:41:35.025815 25171 tablet_service.cc:1514] Processing DeleteTablet for tablet 669d856c58ba476da127e3124b1a2856 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:41:35 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:46120
I20260619 06:41:35.027020 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 24974
I20260619 06:41:35.082772 25413 tablet_replica.cc:330] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c: stopping tablet replica
I20260619 06:41:35.083402 25413 raft_consensus.cc:2229] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:41:35.084136 25413 raft_consensus.cc:2258] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:41:35.085114 25412 tablet_replica.cc:330] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443: stopping tablet replica
I20260619 06:41:35.085613 25412 raft_consensus.cc:2229] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:41:35.088990 25412 raft_consensus.cc:2258] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:41:35.091729 25413 ts_tablet_manager.cc:1905] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:41:35.091732 25412 ts_tablet_manager.cc:1905] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:41:35.098066 25411 tablet_replica.cc:330] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b: stopping tablet replica
I20260619 06:41:35.098788 25411 raft_consensus.cc:2229] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:41:35.099104 25413 ts_tablet_manager.cc:1918] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:41:35.099262 25413 log.cc:1196] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/669d856c58ba476da127e3124b1a2856
Jun 19 06:41:35 dist-test-slave-7lz4 krb5kdc[24868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:41:35.101559 25413 ts_tablet_manager.cc:1939] T 669d856c58ba476da127e3124b1a2856 P 402ad02707c8406ea10588a5ef7a254c: Deleting consensus metadata
I20260619 06:41:35.099560 25411 raft_consensus.cc:2258] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:41:35.105144 24898 catalog_manager.cc:4841] TS 402ad02707c8406ea10588a5ef7a254c (127.10.192.66:33421): tablet 669d856c58ba476da127e3124b1a2856 (table test-table [id=e1b1a6d4c7754c029e6a985b4f7b865b]) successfully deleted
I20260619 06:41:35.105657 25411 ts_tablet_manager.cc:1905] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:41:35.111677 25412 ts_tablet_manager.cc:1918] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:41:35.111891 25412 log.cc:1196] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/669d856c58ba476da127e3124b1a2856
I20260619 06:41:35.112505 25412 ts_tablet_manager.cc:1939] T 669d856c58ba476da127e3124b1a2856 P a0d586be9de2419aad183a8ad50eb443: Deleting consensus metadata
I20260619 06:41:35.113713 25384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:35.028317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51744 (local address 127.10.192.65:43121)
0619 06:41:35.028506 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:35.028512 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:35.074594 (+ 46082us) server_negotiation.cc:407] Connection header received
0619 06:41:35.074930 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:35.074936 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:35.075025 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:35.075118 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:35.077195 (+ 2077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:35.078423 (+ 1228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:35.091849 (+ 13426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:35.092941 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:35.093094 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:35.103447 (+ 10353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:35.103482 (+ 35us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:35.103501 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:35.103564 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:35.109573 (+ 6009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:35.110682 (+ 1109us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:35.110693 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:35.110697 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:35.110897 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:35.111423 (+ 526us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:35.111429 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:35.111433 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:35.111998 (+ 565us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:35.112369 (+ 371us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:35.113035 (+ 666us) server_negotiation.cc:299] Negotiation successful
0619 06:41:35.113289 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 06:41:35.114590 24898 catalog_manager.cc:4841] TS a0d586be9de2419aad183a8ad50eb443 (127.10.192.65:43121): tablet 669d856c58ba476da127e3124b1a2856 (table test-table [id=e1b1a6d4c7754c029e6a985b4f7b865b]) successfully deleted
I20260619 06:41:35.115763 25097 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:35.117101 25411 ts_tablet_manager.cc:1918] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:41:35.117341 25411 log.cc:1196] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/669d856c58ba476da127e3124b1a2856
I20260619 06:41:35.118045 25411 ts_tablet_manager.cc:1939] T 669d856c58ba476da127e3124b1a2856 P f819cb11dd424c299e25363ca5c6416b: Deleting consensus metadata
I20260619 06:41:35.120177 24897 catalog_manager.cc:4841] TS f819cb11dd424c299e25363ca5c6416b (127.10.192.67:34481): tablet 669d856c58ba476da127e3124b1a2856 (table test-table [id=e1b1a6d4c7754c029e6a985b4f7b865b]) successfully deleted
I20260619 06:41:35.212464 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 24974
I20260619 06:41:35.230777 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 25108
Jun 19 06:41:35 dist-test-slave-7lz4 krb5kdc[24868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.66@KRBTEST.COM
I20260619 06:41:35.252034 25388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:35.231712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46126 (local address 127.10.192.66:33421)
0619 06:41:35.231913 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:35.231919 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:35.231941 (+ 22us) server_negotiation.cc:407] Connection header received
0619 06:41:35.232008 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:35.232014 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:35.232093 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:35.232209 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:35.233536 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:35.234355 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:35.235773 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:35.236184 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:35.236325 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:35.245642 (+ 9317us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:35.245660 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:35.245676 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:35.245719 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:35.248873 (+ 3154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:35.249747 (+ 874us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:35.249755 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:35.249757 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:35.249892 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:35.250311 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:35.250315 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:35.250317 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:35.250720 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:35.251028 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:35.251347 (+ 319us) server_negotiation.cc:299] Negotiation successful
0619 06:41:35.251581 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260619 06:41:35.252727 25231 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:35.344825 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 25108
I20260619 06:41:35.368470 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 25242
Jun 19 06:41:35 dist-test-slave-7lz4 krb5kdc[24868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851292, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.67@KRBTEST.COM
I20260619 06:41:35.387030 25387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:35.369284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48676 (local address 127.10.192.67:34481)
0619 06:41:35.369501 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:35.369507 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:35.369530 (+ 23us) server_negotiation.cc:407] Connection header received
0619 06:41:35.369691 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:35.369696 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:35.369786 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:35.369918 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:35.371204 (+ 1286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:35.372592 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:35.373894 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:35.374640 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:35.374797 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:35.379213 (+ 4416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:35.379235 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:35.379255 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:35.379308 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:35.383610 (+ 4302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:35.384646 (+ 1036us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:35.384663 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:35.384666 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:35.384882 (+ 216us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:35.385267 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:35.385272 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:35.385276 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:35.385778 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:35.386117 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:35.386287 (+ 170us) server_negotiation.cc:299] Negotiation successful
0619 06:41:35.386535 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260619 06:41:35.387878 25365 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:35.514207 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 25242
I20260619 06:41:35.534246 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 24881
I20260619 06:41:35.535423 24943 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:35.661109 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 24881
I20260619 06:41:35.682451 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:37455
--webserver_interface=127.10.192.126
--webserver_port=44119
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:42001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:37455
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:41:36.021884 25419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:36.022236 25419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:36.022336 25419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:36.030447 25419 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:41:36.030591 25419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:36.030642 25419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:36.030699 25419 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:41:36.030746 25419 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:41:36.040881 25419 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:42001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:37455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:37455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=44119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:36.042218 25419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:36.043498 25419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:36.067034 25426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:36.067080 25428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:36.067003 25425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:36.072964 25419 server_base.cc:1034] running on GCE node
I20260619 06:41:36.074023 25419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:36.075778 25419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:36.076993 25419 hybrid_clock.cc:648] HybridClock initialized: now 1781851296076944 us; error 39 us; skew 500 ppm
I20260619 06:41:36.077553 25419 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:36 dist-test-slave-7lz4 krb5kdc[24868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851296, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:36.085538 25419 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:41:36.087414 25419 webserver.cc:460] Webserver started at http://127.10.192.126:44119/ using document root <none> and password file <none>
I20260619 06:41:36.088356 25419 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:36.088519 25419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:36.095077 25419 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260619 06:41:36.098484 25435 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:36.100101 25419 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 06:41:36.100265 25419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "410058977e5947beb4aecb1135b1b606"
format_stamp: "Formatted at 2026-06-19 06:41:32 on dist-test-slave-7lz4"
server_key: "681a9ee15a477c83e0a8840a3e8c3718"
server_key_iv: "5c26a34c173f0d553ba9a1a1ecd7882b"
server_key_version: "encryptionkey@0"
I20260619 06:41:36.101493 25419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:36.119163 25419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:36.123728 25419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:36.124034 25419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:36.143879 25419 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:37455
I20260619 06:41:36.143904 25486 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:37455 every 8 connection(s)
I20260619 06:41:36.145572 25419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:41:36.146574 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 25419
I20260619 06:41:36.147739 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:43121
--local_ip_for_outbound_sockets=127.10.192.65
--tserver_master_addrs=127.10.192.126:37455
--webserver_port=40037
--webserver_interface=127.10.192.65
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:42001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:41:36.156759 25487 sys_catalog.cc:263] Verifying existing consensus state
I20260619 06:41:36.160455 25487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606: Bootstrap starting.
I20260619 06:41:36.181674 25487 log.cc:824] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:36.194442 25487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 06:41:36.195013 25487 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606: Bootstrap complete.
I20260619 06:41:36.204698 25487 raft_consensus.cc:348] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "410058977e5947beb4aecb1135b1b606" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37455 } }
I20260619 06:41:36.205866 25487 raft_consensus.cc:729] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 410058977e5947beb4aecb1135b1b606, State: Initialized, Role: FOLLOWER
I20260619 06:41:36.206601 25487 consensus_queue.cc:260] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "410058977e5947beb4aecb1135b1b606" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37455 } }
I20260619 06:41:36.206868 25487 raft_consensus.cc:388] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:41:36.207000 25487 raft_consensus.cc:482] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:41:36.207197 25487 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 1 FOLLOWER]: Advancing to term 2
I20260619 06:41:36.211205 25487 raft_consensus.cc:504] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "410058977e5947beb4aecb1135b1b606" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37455 } }
I20260619 06:41:36.211894 25487 leader_election.cc:302] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 410058977e5947beb4aecb1135b1b606; no voters:
I20260619 06:41:36.212575 25487 leader_election.cc:288] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260619 06:41:36.212733 25491 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 2 FOLLOWER]: Leader election won for term 2
I20260619 06:41:36.214017 25491 raft_consensus.cc:686] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 2 LEADER]: Becoming Leader. State: Replica: 410058977e5947beb4aecb1135b1b606, State: Running, Role: LEADER
I20260619 06:41:36.214604 25491 consensus_queue.cc:237] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "410058977e5947beb4aecb1135b1b606" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37455 } }
I20260619 06:41:36.215006 25487 sys_catalog.cc:564] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:41:36.217145 25493 sys_catalog.cc:455] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 410058977e5947beb4aecb1135b1b606. Latest consensus state: current_term: 2 leader_uuid: "410058977e5947beb4aecb1135b1b606" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "410058977e5947beb4aecb1135b1b606" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37455 } } }
I20260619 06:41:36.217540 25493 sys_catalog.cc:458] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [sys.catalog]: This master's current role is: LEADER
I20260619 06:41:36.218127 25492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "410058977e5947beb4aecb1135b1b606" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "410058977e5947beb4aecb1135b1b606" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37455 } } }
I20260619 06:41:36.218442 25492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [sys.catalog]: This master's current role is: LEADER
I20260619 06:41:36.225618 25497 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:41:36.237311 25497 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:41:36.239353 25497 catalog_manager.cc:1259] Loaded cluster ID: c190ba971e564c9299cbabe65373aef6
I20260619 06:41:36.239506 25497 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:41:36.244436 25497 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260619 06:41:36.263321 25497 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260619 06:41:36.284299 25497 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:41:36.286533 25497 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606: Loaded TSK: 0
I20260619 06:41:36.288627 25497 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260619 06:41:36.535059 25489 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:36.535415 25489 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:36.535601 25489 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:36.543154 25489 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:36.543339 25489 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:36.543527 25489 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:41:36.553793 25489 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:42001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:43121
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=40037
--tserver_master_addrs=127.10.192.126:37455
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:36.555205 25489 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:36.556726 25489 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:36.572575 25514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:36.572543 25515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:36.573743 25517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:36.574198 25489 server_base.cc:1034] running on GCE node
I20260619 06:41:36.574913 25489 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:36.576131 25489 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:36.577374 25489 hybrid_clock.cc:648] HybridClock initialized: now 1781851296577300 us; error 65 us; skew 500 ppm
I20260619 06:41:36.577731 25489 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:36 dist-test-slave-7lz4 krb5kdc[24868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851296, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:36.581188 25489 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:41:36.582969 25489 webserver.cc:460] Webserver started at http://127.10.192.65:40037/ using document root <none> and password file <none>
I20260619 06:41:36.583812 25489 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:36.583961 25489 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:36.589816 25489 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260619 06:41:36.592962 25524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:36.594599 25489 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:41:36.594805 25489 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "a0d586be9de2419aad183a8ad50eb443"
format_stamp: "Formatted at 2026-06-19 06:41:33 on dist-test-slave-7lz4"
server_key: "76ee77cf46d4fb0ff7e051c4ddb51578"
server_key_iv: "22a736aa67511f8f3874819119ff7160"
server_key_version: "encryptionkey@0"
I20260619 06:41:36.595942 25489 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:36.627912 25489 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:36.632836 25489 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:36.633147 25489 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:36.634202 25489 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:41:36.635746 25489 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:41:36.635845 25489 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:36.635974 25489 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:41:36.636054 25489 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:36.670220 25489 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:43121
I20260619 06:41:36.670341 25636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:43121 every 8 connection(s)
I20260619 06:41:36.671876 25489 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:41:36.676028 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 25489
I20260619 06:41:36.676719 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:33421
--local_ip_for_outbound_sockets=127.10.192.66
--tserver_master_addrs=127.10.192.126:37455
--webserver_port=44977
--webserver_interface=127.10.192.66
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:42001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 06:41:36 dist-test-slave-7lz4 krb5kdc[24868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851296, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:36.699417 25640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:36.675450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:56469)
0619 06:41:36.676392 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:36.676439 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:36.678258 (+ 1819us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:36.679990 (+ 1732us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:36.679998 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:36.680536 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:36.681143 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:36.681164 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:36.683729 (+ 2565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:36.683733 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:36.685283 (+ 1550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:36.685316 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:36.686374 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:36.686383 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:36.686711 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:36.687501 (+ 790us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:36.687536 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:36.690310 (+ 2774us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:36.694800 (+ 4490us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:36.694809 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:36.694823 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:36.695399 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:36.696014 (+ 615us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:36.696018 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:36.696020 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:36.696203 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:36.697309 (+ 1106us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:36.697315 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:36.697629 (+ 314us) client_negotiation.cc:769] Sending connection context
0619 06:41:36.697878 (+ 249us) client_negotiation.cc:240] Negotiation successful
0619 06:41:36.698310 (+ 432us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":422,"threads_started":1}
I20260619 06:41:36.700155 25639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:36.675105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:56469 (local address 127.10.192.126:37455)
0619 06:41:36.675889 (+ 784us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:36.675910 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:36.676597 (+ 687us) server_negotiation.cc:407] Connection header received
0619 06:41:36.678902 (+ 2305us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:36.678923 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:36.679422 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:36.679885 (+ 463us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:36.681394 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:36.683475 (+ 2081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:36.685456 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:36.686119 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:36.686264 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:36.690620 (+ 4356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:36.690629 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:36.690647 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:36.690692 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:36.694622 (+ 3930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:36.695590 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:36.695603 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:36.695615 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:36.695893 (+ 278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:36.696353 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:36.696361 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:36.696367 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:36.697143 (+ 776us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:36.697366 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:36.698211 (+ 845us) server_negotiation.cc:299] Negotiation successful
0619 06:41:36.698739 (+ 528us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":307,"threads_started":1}
I20260619 06:41:36.703824 25637 heartbeater.cc:347] Connected to a master server at 127.10.192.126:37455
I20260619 06:41:36.704190 25637 heartbeater.cc:464] Registering TS with master...
I20260619 06:41:36.705089 25637 heartbeater.cc:511] Master 127.10.192.126:37455 requested a full tablet report, sending...
I20260619 06:41:36.708822 25452 ts_manager.cc:194] Registered new tserver with Master: a0d586be9de2419aad183a8ad50eb443 (127.10.192.65:43121)
I20260619 06:41:36.710327 25452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:56469
W20260619 06:41:37.019253 25641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:37.019569 25641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:37.019760 25641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:37.027117 25641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:37.027245 25641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:37.027360 25641 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:41:37.037513 25641 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:42001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:33421
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=44977
--tserver_master_addrs=127.10.192.126:37455
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:37.038873 25641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:37.040210 25641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:37.053884 25649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:37.054054 25646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:37.053915 25647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:37.054803 25641 server_base.cc:1034] running on GCE node
I20260619 06:41:37.055426 25641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:37.056459 25641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:37.057663 25641 hybrid_clock.cc:648] HybridClock initialized: now 1781851297057588 us; error 66 us; skew 500 ppm
I20260619 06:41:37.058007 25641 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:37 dist-test-slave-7lz4 krb5kdc[24868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851297, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:37.061450 25641 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:41:37.063151 25641 webserver.cc:460] Webserver started at http://127.10.192.66:44977/ using document root <none> and password file <none>
I20260619 06:41:37.063948 25641 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:37.064106 25641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:37.069692 25641 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260619 06:41:37.072742 25656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:37.074206 25641 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:41:37.074395 25641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "402ad02707c8406ea10588a5ef7a254c"
format_stamp: "Formatted at 2026-06-19 06:41:34 on dist-test-slave-7lz4"
server_key: "b844f28660d1c9824e324c2706de4c81"
server_key_iv: "3a678d1cb4cf6fedbde71a0d9a161882"
server_key_version: "encryptionkey@0"
I20260619 06:41:37.075740 25641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:37.090670 25641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:37.095557 25641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:37.095876 25641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:37.096858 25641 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:41:37.098245 25641 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:41:37.098372 25641 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:37.098495 25641 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:41:37.098580 25641 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:37.132702 25641 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:33421
I20260619 06:41:37.132802 25768 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:33421 every 8 connection(s)
I20260619 06:41:37.134259 25641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:41:37.143939 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 25641
I20260619 06:41:37.144670 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:34481
--local_ip_for_outbound_sockets=127.10.192.67
--tserver_master_addrs=127.10.192.126:37455
--webserver_port=33471
--webserver_interface=127.10.192.67
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:42001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 06:41:37 dist-test-slave-7lz4 krb5kdc[24868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851297, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:37.155783 25639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:37.136868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:54785 (local address 127.10.192.126:37455)
0619 06:41:37.137076 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:37.137082 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:37.138378 (+ 1296us) server_negotiation.cc:407] Connection header received
0619 06:41:37.140219 (+ 1841us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:37.140224 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:37.140299 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:37.140393 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:37.141944 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.142658 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.144486 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.145090 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.145240 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:37.148844 (+ 3604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:37.148850 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:37.148853 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:37.148887 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:37.151856 (+ 2969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:37.152646 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:37.152653 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:37.152658 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:37.152839 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:37.153410 (+ 571us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:37.153417 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:37.153422 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:37.153880 (+ 458us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:37.154049 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:37.154965 (+ 916us) server_negotiation.cc:299] Negotiation successful
0619 06:41:37.155227 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260619 06:41:37.156795 25771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:37.137434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:54785)
0619 06:41:37.138223 (+ 789us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:37.138263 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:37.139920 (+ 1657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:37.140620 (+ 700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:37.140628 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:37.141186 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:37.141757 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:37.141773 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.142793 (+ 1020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.142796 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:37.144322 (+ 1526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:37.144334 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.145331 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.145338 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:37.145582 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:37.146319 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:37.146343 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:37.148620 (+ 2277us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:37.152019 (+ 3399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:37.152029 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:37.152048 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:37.152504 (+ 456us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:37.152984 (+ 480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:37.152990 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:37.152994 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:37.153260 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:37.154037 (+ 777us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:37.154045 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:37.154501 (+ 456us) client_negotiation.cc:769] Sending connection context
0619 06:41:37.154795 (+ 294us) client_negotiation.cc:240] Negotiation successful
0619 06:41:37.155358 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":289,"threads_started":1}
I20260619 06:41:37.158429 25769 heartbeater.cc:347] Connected to a master server at 127.10.192.126:37455
I20260619 06:41:37.158782 25769 heartbeater.cc:464] Registering TS with master...
I20260619 06:41:37.159740 25769 heartbeater.cc:511] Master 127.10.192.126:37455 requested a full tablet report, sending...
I20260619 06:41:37.161463 25452 ts_manager.cc:194] Registered new tserver with Master: 402ad02707c8406ea10588a5ef7a254c (127.10.192.66:33421)
I20260619 06:41:37.162595 25452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:54785
W20260619 06:41:37.482710 25772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:37.483044 25772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:37.483254 25772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:37.490651 25772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:37.490824 25772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:37.491012 25772 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:41:37.501166 25772 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:42001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:34481
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=33471
--tserver_master_addrs=127.10.192.126:37455
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:37.502545 25772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:37.504025 25772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:37.517956 25778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:37.518453 25780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:37.519271 25772 server_base.cc:1034] running on GCE node
W20260619 06:41:37.519513 25777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:37.520406 25772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:37.521754 25772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:37.523012 25772 hybrid_clock.cc:648] HybridClock initialized: now 1781851297522939 us; error 64 us; skew 500 ppm
I20260619 06:41:37.523329 25772 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:37 dist-test-slave-7lz4 krb5kdc[24868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851297, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:37.526772 25772 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:41:37.528532 25772 webserver.cc:460] Webserver started at http://127.10.192.67:33471/ using document root <none> and password file <none>
I20260619 06:41:37.529321 25772 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:37.529505 25772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:37.535506 25772 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260619 06:41:37.538524 25787 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:37.540074 25772 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:41:37.540277 25772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "f819cb11dd424c299e25363ca5c6416b"
format_stamp: "Formatted at 2026-06-19 06:41:34 on dist-test-slave-7lz4"
server_key: "73b8b984464f1013725cf82e1fa4137e"
server_key_iv: "46b777cb677a4b0876c1eac2ac2a2db8"
server_key_version: "encryptionkey@0"
I20260619 06:41:37.541361 25772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:37.588449 25772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:37.592875 25772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:37.593179 25772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:37.594228 25772 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:41:37.595676 25772 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:41:37.595803 25772 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:37.595937 25772 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:41:37.596026 25772 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:37.630235 25772 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:34481
I20260619 06:41:37.630297 25899 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:34481 every 8 connection(s)
I20260619 06:41:37.631901 25772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:41:37.632886 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 25772
Jun 19 06:41:37 dist-test-slave-7lz4 krb5kdc[24868](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851297, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:37.650029 25639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:37.634019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36098 (local address 127.10.192.126:37455)
0619 06:41:37.634256 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:37.634267 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:37.634774 (+ 507us) server_negotiation.cc:407] Connection header received
0619 06:41:37.634984 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:37.634992 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:37.635104 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:37.635247 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:37.637277 (+ 2030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.638479 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.640102 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.640723 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.640876 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:37.643768 (+ 2892us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:37.643777 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:37.643781 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:37.643821 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:37.646939 (+ 3118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:37.647821 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:37.647829 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:37.647833 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:37.647990 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:37.648372 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:37.648376 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:37.648379 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:37.648735 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:37.648957 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:37.649343 (+ 386us) server_negotiation.cc:299] Negotiation successful
0619 06:41:37.649622 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74,"spinlock_wait_cycles":2432}
I20260619 06:41:37.655391 25903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:37.634838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:47939 (local address 127.10.192.126:37455)
0619 06:41:37.637317 (+ 2479us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:37.637322 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:37.637336 (+ 14us) server_negotiation.cc:407] Connection header received
0619 06:41:37.639106 (+ 1770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:37.639111 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:37.639188 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:37.639305 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:37.641188 (+ 1883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.642337 (+ 1149us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.644032 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.644514 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.644650 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:37.648650 (+ 4000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:37.648659 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:37.648664 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:37.648702 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:37.652158 (+ 3456us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:37.653162 (+ 1004us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:37.653166 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:37.653168 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:37.653280 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:37.653776 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:37.653779 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:37.653781 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:37.654040 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:37.654146 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:37.654855 (+ 709us) server_negotiation.cc:299] Negotiation successful
0619 06:41:37.655080 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2361,"thread_start_us":270,"threads_started":1}
I20260619 06:41:37.656507 25904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:37.635733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:47939)
0619 06:41:37.636579 (+ 846us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:37.636624 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:37.638843 (+ 2219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:37.639515 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:37.639524 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:37.640152 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:37.640989 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:37.641014 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.642492 (+ 1478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.642496 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:37.643894 (+ 1398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:37.643908 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.644760 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.644770 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:37.645025 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:37.645708 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:37.645733 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:37.648384 (+ 2651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:37.652333 (+ 3949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:37.652342 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:37.652356 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:37.653038 (+ 682us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:37.653403 (+ 365us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:37.653407 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:37.653409 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:37.653656 (+ 247us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:37.654161 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:37.654166 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:37.654520 (+ 354us) client_negotiation.cc:769] Sending connection context
0619 06:41:37.654775 (+ 255us) client_negotiation.cc:240] Negotiation successful
0619 06:41:37.655202 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":582,"thread_start_us":358,"threads_started":1}
I20260619 06:41:37.658262 25900 heartbeater.cc:347] Connected to a master server at 127.10.192.126:37455
I20260619 06:41:37.658629 25900 heartbeater.cc:464] Registering TS with master...
I20260619 06:41:37.659459 25900 heartbeater.cc:511] Master 127.10.192.126:37455 requested a full tablet report, sending...
I20260619 06:41:37.661110 25452 ts_manager.cc:194] Registered new tserver with Master: f819cb11dd424c299e25363ca5c6416b (127.10.192.67:34481)
I20260619 06:41:37.661942 25452 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:47939
I20260619 06:41:37.665551 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 06:41:37.673496 25903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:37.666497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36114 (local address 127.10.192.126:37455)
0619 06:41:37.666705 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:37.666714 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:37.667182 (+ 468us) server_negotiation.cc:407] Connection header received
0619 06:41:37.667377 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:37.667382 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:37.667544 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:37.667775 (+ 231us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:41:37.668192 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.668919 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.670978 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.671488 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.671683 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:37.672279 (+ 596us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:41:37.672822 (+ 543us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:41:37.673032 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:37.673133 (+ 101us) server_negotiation.cc:299] Negotiation successful
0619 06:41:37.673224 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 06:41:37.674594 25452 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:36114:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:41:37.682014 25452 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:41:37.709228 25912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:37.694144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:33421 (local address 127.0.0.1:46140)
0619 06:41:37.696829 (+ 2685us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:37.696889 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:37.697067 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:37.698243 (+ 1176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:37.698254 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:37.698297 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:37.698864 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:37.698881 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.701380 (+ 2499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.701389 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:37.704768 (+ 3379us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:37.704791 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.707832 (+ 3041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.707841 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:37.708120 (+ 279us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:37.708178 (+ 58us) client_negotiation.cc:769] Sending connection context
0619 06:41:37.708346 (+ 168us) client_negotiation.cc:240] Negotiation successful
0619 06:41:37.708655 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2403,"thread_start_us":2389,"threads_started":1}
I20260619 06:41:37.710422 25911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:37.694308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46140 (local address 127.10.192.66:33421)
0619 06:41:37.696278 (+ 1970us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:37.696287 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:37.697108 (+ 821us) server_negotiation.cc:407] Connection header received
0619 06:41:37.697355 (+ 247us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:37.697366 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:37.697660 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:37.697885 (+ 225us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:37.699124 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.701174 (+ 2050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.705042 (+ 3868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.707122 (+ 2080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.707297 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:37.707590 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:37.709744 (+ 2154us) server_negotiation.cc:299] Negotiation successful
0619 06:41:37.710020 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1758,"thread_start_us":1636,"threads_started":1}
I20260619 06:41:37.713604 25637 heartbeater.cc:503] Master 127.10.192.126:37455 was elected leader, sending a full tablet report...
I20260619 06:41:37.714610 25910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:37.694601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:34481 (local address 127.0.0.1:48690)
0619 06:41:37.696828 (+ 2227us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:37.696890 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:37.697103 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:37.699590 (+ 2487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:37.699598 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:37.699662 (+ 64us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:37.700154 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:37.700172 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.704381 (+ 4209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.704391 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:37.708909 (+ 4518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:37.708931 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.713808 (+ 4877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.713817 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:37.713996 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:37.714036 (+ 40us) client_negotiation.cc:769] Sending connection context
0619 06:41:37.714112 (+ 76us) client_negotiation.cc:240] Negotiation successful
0619 06:41:37.714266 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2076,"thread_start_us":1771,"threads_started":1}
I20260619 06:41:37.715922 25913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:37.694837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48690 (local address 127.10.192.67:34481)
0619 06:41:37.695743 (+ 906us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:37.695756 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:37.696997 (+ 1241us) server_negotiation.cc:407] Connection header received
0619 06:41:37.698689 (+ 1692us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:37.698701 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:37.698995 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:37.699192 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:37.700426 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.704123 (+ 3697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.709149 (+ 5026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.712780 (+ 3631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.713087 (+ 307us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:37.715361 (+ 2274us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:37.715439 (+ 78us) server_negotiation.cc:299] Negotiation successful
0619 06:41:37.715580 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":680,"thread_start_us":529,"threads_started":1}
I20260619 06:41:37.716430 25704 tablet_service.cc:1467] Processing CreateTablet for tablet 29e39c1f25614818a233f5e1038de437 (DEFAULT_TABLE table=test-table [id=00fbafdaeb15446aa75065c13ce517a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:41:37.717868 25704 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29e39c1f25614818a233f5e1038de437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:41:37.719797 25912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:37.697266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:43121 (local address 127.0.0.1:51758)
0619 06:41:37.710983 (+ 13717us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:37.711014 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:37.711151 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:37.713165 (+ 2014us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:37.713170 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:37.713198 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:37.713363 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:37.713374 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.715358 (+ 1984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.715363 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:37.717145 (+ 1782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:37.717160 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.719008 (+ 1848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.719014 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:37.719208 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:37.719244 (+ 36us) client_negotiation.cc:769] Sending connection context
0619 06:41:37.719314 (+ 70us) client_negotiation.cc:240] Negotiation successful
0619 06:41:37.719472 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13572,"thread_start_us":14461,"threads_started":1}
I20260619 06:41:37.719707 25835 tablet_service.cc:1467] Processing CreateTablet for tablet 29e39c1f25614818a233f5e1038de437 (DEFAULT_TABLE table=test-table [id=00fbafdaeb15446aa75065c13ce517a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:41:37.720655 25915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:37.697609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51758 (local address 127.10.192.65:43121)
0619 06:41:37.712449 (+ 14840us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:37.712460 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:37.712492 (+ 32us) server_negotiation.cc:407] Connection header received
0619 06:41:37.712596 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:37.712603 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:37.712917 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:37.713188 (+ 271us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:37.713570 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.715099 (+ 1529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.717304 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.718757 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.719794 (+ 1037us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:37.720054 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:37.720130 (+ 76us) server_negotiation.cc:299] Negotiation successful
0619 06:41:37.720308 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14663,"thread_start_us":14523,"threads_started":1}
I20260619 06:41:37.721159 25835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29e39c1f25614818a233f5e1038de437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:41:37.724418 25572 tablet_service.cc:1467] Processing CreateTablet for tablet 29e39c1f25614818a233f5e1038de437 (DEFAULT_TABLE table=test-table [id=00fbafdaeb15446aa75065c13ce517a1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:41:37.726017 25572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29e39c1f25614818a233f5e1038de437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:41:37.731359 25916 tablet_bootstrap.cc:492] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c: Bootstrap starting.
I20260619 06:41:37.734546 25916 tablet_bootstrap.cc:654] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c: Neither blocks nor log segments found. Creating new log.
I20260619 06:41:37.735702 25916 log.cc:824] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:37.736971 25917 tablet_bootstrap.cc:492] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b: Bootstrap starting.
I20260619 06:41:37.740447 25917 tablet_bootstrap.cc:654] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b: Neither blocks nor log segments found. Creating new log.
I20260619 06:41:37.740522 25916 tablet_bootstrap.cc:492] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c: No bootstrap required, opened a new log
I20260619 06:41:37.740797 25916 ts_tablet_manager.cc:1397] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260619 06:41:37.741593 25917 log.cc:824] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:37.743772 25920 tablet_bootstrap.cc:492] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443: Bootstrap starting.
I20260619 06:41:37.744947 25917 tablet_bootstrap.cc:492] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b: No bootstrap required, opened a new log
I20260619 06:41:37.745283 25917 ts_tablet_manager.cc:1397] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260619 06:41:37.747521 25920 tablet_bootstrap.cc:654] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443: Neither blocks nor log segments found. Creating new log.
I20260619 06:41:37.749223 25920 log.cc:824] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:37.749384 25916 raft_consensus.cc:348] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } } peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } }
I20260619 06:41:37.749886 25916 raft_consensus.cc:374] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:41:37.749989 25916 raft_consensus.cc:729] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 402ad02707c8406ea10588a5ef7a254c, State: Initialized, Role: FOLLOWER
I20260619 06:41:37.750635 25916 consensus_queue.cc:260] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } } peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } }
I20260619 06:41:37.751883 25769 heartbeater.cc:503] Master 127.10.192.126:37455 was elected leader, sending a full tablet report...
I20260619 06:41:37.752363 25916 ts_tablet_manager.cc:1428] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20260619 06:41:37.755270 25920 tablet_bootstrap.cc:492] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443: No bootstrap required, opened a new log
I20260619 06:41:37.755587 25920 ts_tablet_manager.cc:1397] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s
I20260619 06:41:37.757120 25917 raft_consensus.cc:348] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } } peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } }
I20260619 06:41:37.757575 25917 raft_consensus.cc:374] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:41:37.757686 25917 raft_consensus.cc:729] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f819cb11dd424c299e25363ca5c6416b, State: Initialized, Role: FOLLOWER
I20260619 06:41:37.758381 25917 consensus_queue.cc:260] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } } peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } }
I20260619 06:41:37.759773 25900 heartbeater.cc:503] Master 127.10.192.126:37455 was elected leader, sending a full tablet report...
I20260619 06:41:37.760357 25917 ts_tablet_manager.cc:1428] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260619 06:41:37.765031 25920 raft_consensus.cc:348] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } } peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } }
I20260619 06:41:37.765409 25920 raft_consensus.cc:374] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:41:37.765482 25920 raft_consensus.cc:729] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0d586be9de2419aad183a8ad50eb443, State: Initialized, Role: FOLLOWER
I20260619 06:41:37.765986 25920 consensus_queue.cc:260] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } } peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } }
I20260619 06:41:37.767520 25920 ts_tablet_manager.cc:1428] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s
W20260619 06:41:37.883803 25901 tablet.cc:2369] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 06:41:37.886253 25770 tablet.cc:2369] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 06:41:37.924482 25638 tablet.cc:2369] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:41:37.960994 25924 raft_consensus.cc:482] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:41:37.961365 25924 raft_consensus.cc:504] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } } peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } }
I20260619 06:41:37.963176 25924 leader_election.cc:288] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 402ad02707c8406ea10588a5ef7a254c (127.10.192.66:33421), f819cb11dd424c299e25363ca5c6416b (127.10.192.67:34481)
I20260619 06:41:37.972671 25913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:37.963683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:36299 (local address 127.10.192.67:34481)
0619 06:41:37.963937 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:37.963946 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:37.964512 (+ 566us) server_negotiation.cc:407] Connection header received
0619 06:41:37.964734 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:37.964738 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:37.964808 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:37.964911 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:37.965721 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.966850 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.970142 (+ 3292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.971397 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.971584 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:37.971760 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:37.972263 (+ 503us) server_negotiation.cc:299] Negotiation successful
0619 06:41:37.972407 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260619 06:41:37.972716 25911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:37.963692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:37507 (local address 127.10.192.66:33421)
0619 06:41:37.963914 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:37.963921 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:37.964520 (+ 599us) server_negotiation.cc:407] Connection header received
0619 06:41:37.964719 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:37.964724 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:37.964808 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:37.964911 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:37.965713 (+ 802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.966843 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.970133 (+ 3290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.971433 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.971650 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:37.971755 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:37.972287 (+ 532us) server_negotiation.cc:299] Negotiation successful
0619 06:41:37.972416 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260619 06:41:37.972993 25926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:37.963588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:34481 (local address 127.10.192.65:36299)
0619 06:41:37.964396 (+ 808us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:37.964411 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:37.964564 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:37.964957 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:37.964962 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:37.965009 (+ 47us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:37.965502 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:37.965523 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.967008 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.967014 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:37.969925 (+ 2911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:37.969945 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.971732 (+ 1787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.971738 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:37.972007 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:37.972086 (+ 79us) client_negotiation.cc:769] Sending connection context
0619 06:41:37.972196 (+ 110us) client_negotiation.cc:240] Negotiation successful
0619 06:41:37.972350 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"mutex_wait_us":252,"spinlock_wait_cycles":24320,"thread_start_us":556,"threads_started":1}
I20260619 06:41:37.973016 25925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:37.963508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:33421 (local address 127.10.192.65:37507)
0619 06:41:37.964359 (+ 851us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:37.964386 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:37.964565 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:37.964957 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:37.964962 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:37.965008 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:37.965559 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:37.965568 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.967008 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.967014 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:37.969925 (+ 2911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:37.969945 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:37.971718 (+ 1773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:37.971725 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:37.972007 (+ 282us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:37.972157 (+ 150us) client_negotiation.cc:769] Sending connection context
0619 06:41:37.972234 (+ 77us) client_negotiation.cc:240] Negotiation successful
0619 06:41:37.972349 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":682,"mutex_wait_us":349,"spinlock_wait_cycles":48512,"thread_start_us":446,"threads_started":1}
I20260619 06:41:37.974117 25724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29e39c1f25614818a233f5e1038de437" candidate_uuid: "a0d586be9de2419aad183a8ad50eb443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402ad02707c8406ea10588a5ef7a254c" is_pre_election: true
I20260619 06:41:37.974107 25855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29e39c1f25614818a233f5e1038de437" candidate_uuid: "a0d586be9de2419aad183a8ad50eb443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f819cb11dd424c299e25363ca5c6416b" is_pre_election: true
I20260619 06:41:37.974604 25855 raft_consensus.cc:2454] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0d586be9de2419aad183a8ad50eb443 in term 0.
I20260619 06:41:37.974612 25724 raft_consensus.cc:2454] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a0d586be9de2419aad183a8ad50eb443 in term 0.
I20260619 06:41:37.975335 25525 leader_election.cc:302] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 402ad02707c8406ea10588a5ef7a254c, a0d586be9de2419aad183a8ad50eb443, f819cb11dd424c299e25363ca5c6416b; no voters:
I20260619 06:41:37.975785 25924 raft_consensus.cc:2781] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:41:37.975936 25924 raft_consensus.cc:482] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:41:37.976063 25924 raft_consensus.cc:3037] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:41:37.978369 25924 raft_consensus.cc:504] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } } peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } }
I20260619 06:41:37.979110 25924 leader_election.cc:288] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [CANDIDATE]: Term 1 election: Requested vote from peers 402ad02707c8406ea10588a5ef7a254c (127.10.192.66:33421), f819cb11dd424c299e25363ca5c6416b (127.10.192.67:34481)
I20260619 06:41:37.979571 25724 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29e39c1f25614818a233f5e1038de437" candidate_uuid: "a0d586be9de2419aad183a8ad50eb443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "402ad02707c8406ea10588a5ef7a254c"
I20260619 06:41:37.979691 25855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29e39c1f25614818a233f5e1038de437" candidate_uuid: "a0d586be9de2419aad183a8ad50eb443" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f819cb11dd424c299e25363ca5c6416b"
I20260619 06:41:37.979858 25724 raft_consensus.cc:3037] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:41:37.979923 25855 raft_consensus.cc:3037] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:41:37.982168 25724 raft_consensus.cc:2454] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0d586be9de2419aad183a8ad50eb443 in term 1.
I20260619 06:41:37.982177 25855 raft_consensus.cc:2454] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a0d586be9de2419aad183a8ad50eb443 in term 1.
I20260619 06:41:37.982671 25526 leader_election.cc:302] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 402ad02707c8406ea10588a5ef7a254c, a0d586be9de2419aad183a8ad50eb443, f819cb11dd424c299e25363ca5c6416b; no voters:
I20260619 06:41:37.983100 25924 raft_consensus.cc:2781] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:41:37.983572 25924 raft_consensus.cc:686] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [term 1 LEADER]: Becoming Leader. State: Replica: a0d586be9de2419aad183a8ad50eb443, State: Running, Role: LEADER
I20260619 06:41:37.984184 25924 consensus_queue.cc:237] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } } peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } }
I20260619 06:41:37.988853 25451 catalog_manager.cc:5495] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 reported cstate change: term changed from 0 to 1, leader changed from <none> to a0d586be9de2419aad183a8ad50eb443 (127.10.192.65). New cstate: current_term: 1 leader_uuid: "a0d586be9de2419aad183a8ad50eb443" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a0d586be9de2419aad183a8ad50eb443" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 43121 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 } health_report { overall_health: UNKNOWN } } }
I20260619 06:41:38.006609 25915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:38.000958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51764 (local address 127.10.192.65:43121)
0619 06:41:38.001138 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:38.001143 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:38.001182 (+ 39us) server_negotiation.cc:407] Connection header received
0619 06:41:38.001408 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:38.001412 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:38.001499 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:38.001629 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:41:38.001967 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:38.002685 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:38.004314 (+ 1629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:38.004704 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:38.004795 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:38.005390 (+ 595us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:41:38.005966 (+ 576us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:41:38.006075 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:38.006234 (+ 159us) server_negotiation.cc:299] Negotiation successful
0619 06:41:38.006306 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260619 06:41:38.015300 25855 raft_consensus.cc:1261] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b [term 1 FOLLOWER]: Refusing update from remote peer a0d586be9de2419aad183a8ad50eb443: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:41:38.015298 25724 raft_consensus.cc:1261] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c [term 1 FOLLOWER]: Refusing update from remote peer a0d586be9de2419aad183a8ad50eb443: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:41:38.016423 25924 consensus_queue.cc:1035] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "402ad02707c8406ea10588a5ef7a254c" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 33421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:41:38.016795 25927 consensus_queue.cc:1035] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f819cb11dd424c299e25363ca5c6416b" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 34481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:41:38.043493 25451 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:36114:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:41:38.043852 25451 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:36114:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:41:38.047843 25451 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606: Sending DeleteTablet for 3 replicas of tablet 29e39c1f25614818a233f5e1038de437
I20260619 06:41:38.049173 25572 tablet_service.cc:1514] Processing DeleteTablet for tablet 29e39c1f25614818a233f5e1038de437 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:41:38 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:51758
I20260619 06:41:38.049221 25704 tablet_service.cc:1514] Processing DeleteTablet for tablet 29e39c1f25614818a233f5e1038de437 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:41:38 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:46140
I20260619 06:41:38.049481 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 25489
I20260619 06:41:38.051340 25835 tablet_service.cc:1514] Processing DeleteTablet for tablet 29e39c1f25614818a233f5e1038de437 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:41:38 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:48690
I20260619 06:41:38.060786 25941 tablet_replica.cc:330] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c: stopping tablet replica
I20260619 06:41:38.061568 25941 raft_consensus.cc:2229] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:41:38.062322 25941 raft_consensus.cc:2258] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:41:38.062981 25942 tablet_replica.cc:330] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b: stopping tablet replica
I20260619 06:41:38.063934 25942 raft_consensus.cc:2229] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:41:38.064845 25942 raft_consensus.cc:2258] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:41:38.066741 25941 ts_tablet_manager.cc:1905] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:41:38.068207 25940 tablet_replica.cc:330] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443: stopping tablet replica
I20260619 06:41:38.068583 25940 raft_consensus.cc:2229] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:41:38.069171 25940 raft_consensus.cc:2258] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:41:38.071035 25942 ts_tablet_manager.cc:1905] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:41:38.072551 25915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:38.051932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51774 (local address 127.10.192.65:43121)
0619 06:41:38.052100 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:38.052106 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:38.052127 (+ 21us) server_negotiation.cc:407] Connection header received
0619 06:41:38.052184 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:38.052190 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:38.052269 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:38.052370 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:38.054638 (+ 2268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:38.055905 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:38.057854 (+ 1949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:38.058586 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:38.058709 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:38.063488 (+ 4779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:38.063507 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:38.063526 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:38.063596 (+ 70us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:38.068120 (+ 4524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:38.069202 (+ 1082us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:38.069221 (+ 19us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:38.069225 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:38.069479 (+ 254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:38.070006 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:38.070011 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:38.070014 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:38.070465 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:38.070755 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:38.071847 (+ 1092us) server_negotiation.cc:299] Negotiation successful
0619 06:41:38.072100 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260619 06:41:38.073989 25632 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:38.076972 25941 ts_tablet_manager.cc:1918] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:41:38.077230 25941 log.cc:1196] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/29e39c1f25614818a233f5e1038de437
I20260619 06:41:38.077905 25941 ts_tablet_manager.cc:1939] T 29e39c1f25614818a233f5e1038de437 P 402ad02707c8406ea10588a5ef7a254c: Deleting consensus metadata
I20260619 06:41:38.079183 25942 ts_tablet_manager.cc:1918] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:41:38.079365 25942 log.cc:1196] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/29e39c1f25614818a233f5e1038de437
I20260619 06:41:38.080013 25942 ts_tablet_manager.cc:1939] T 29e39c1f25614818a233f5e1038de437 P f819cb11dd424c299e25363ca5c6416b: Deleting consensus metadata
I20260619 06:41:38.080071 25437 catalog_manager.cc:4841] TS 402ad02707c8406ea10588a5ef7a254c (127.10.192.66:33421): tablet 29e39c1f25614818a233f5e1038de437 (table test-table [id=00fbafdaeb15446aa75065c13ce517a1]) successfully deleted
I20260619 06:41:38.081691 25436 catalog_manager.cc:4841] TS f819cb11dd424c299e25363ca5c6416b (127.10.192.67:34481): tablet 29e39c1f25614818a233f5e1038de437 (table test-table [id=00fbafdaeb15446aa75065c13ce517a1]) successfully deleted
I20260619 06:41:38.185148 25940 ts_tablet_manager.cc:1905] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:41:38.190687 25940 ts_tablet_manager.cc:1918] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:41:38.190910 25940 log.cc:1196] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/29e39c1f25614818a233f5e1038de437
I20260619 06:41:38.191560 25940 ts_tablet_manager.cc:1939] T 29e39c1f25614818a233f5e1038de437 P a0d586be9de2419aad183a8ad50eb443: Deleting consensus metadata
I20260619 06:41:38.191723 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 25489
I20260619 06:41:38.210283 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 25641
W20260619 06:41:38.210182 25437 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.192.65:43121 (error 108)
I20260619 06:41:38.211944 25912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:38.211476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:43121 (local address 127.0.0.1:51788)
0619 06:41:38.211686 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:38.211795 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:43121: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260619 06:41:38.212280 25437 catalog_manager.cc:4584] TS a0d586be9de2419aad183a8ad50eb443 (127.10.192.65:43121): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 29e39c1f25614818a233f5e1038de437: Network error: Client connection negotiation failed: client connection to 127.10.192.65:43121: connect: Connection refused (error 111)
I20260619 06:41:38.225239 25911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:38.211259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46146 (local address 127.10.192.66:33421)
0619 06:41:38.211455 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:38.211462 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:38.211483 (+ 21us) server_negotiation.cc:407] Connection header received
0619 06:41:38.211662 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:38.211669 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:38.211751 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:38.211883 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:38.213536 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:38.214347 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:38.216000 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:38.216521 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:38.216700 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:38.219571 (+ 2871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:38.219586 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:38.219602 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:38.219693 (+ 91us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:38.222350 (+ 2657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:38.223101 (+ 751us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:38.223117 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:38.223121 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:38.223248 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:38.223670 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:38.223675 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:38.223680 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:38.224047 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:38.224364 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:38.224673 (+ 309us) server_negotiation.cc:299] Negotiation successful
0619 06:41:38.224893 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260619 06:41:38.225951 25764 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:38.265888 25912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:38.265426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:43121 (local address 127.0.0.1:51800)
0619 06:41:38.265634 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:38.265741 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:43121: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260619 06:41:38.266930 25912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:38.266586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:43121 (local address 127.0.0.1:51802)
0619 06:41:38.266735 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:38.266813 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:43121: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260619 06:41:38.318171 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 25641
I20260619 06:41:38.327826 25912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:38.327179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:43121 (local address 127.0.0.1:51806)
0619 06:41:38.327440 (+ 261us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:38.327572 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:43121: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260619 06:41:38.329012 25912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:38.328517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:43121 (local address 127.0.0.1:51816)
0619 06:41:38.328701 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:38.328800 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:43121: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260619 06:41:38.335803 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 25772
I20260619 06:41:38.349395 25913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:38.336551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48692 (local address 127.10.192.67:34481)
0619 06:41:38.336757 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:38.336762 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:38.336780 (+ 18us) server_negotiation.cc:407] Connection header received
0619 06:41:38.336889 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:38.336893 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:38.336975 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:38.337055 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:38.338466 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:38.339181 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:38.340564 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:38.340949 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:38.341045 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:38.343774 (+ 2729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:38.343789 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:38.343805 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:38.343846 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:38.346680 (+ 2834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:38.347383 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:38.347390 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:38.347392 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:38.347535 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:38.348047 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:38.348051 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:38.348053 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:38.348406 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:38.348617 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:38.348931 (+ 314us) server_negotiation.cc:299] Negotiation successful
0619 06:41:38.349119 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260619 06:41:38.350068 25895 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:38.410364 25912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:38.409898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:43121 (local address 127.0.0.1:51832)
0619 06:41:38.410104 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:38.410215 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:43121: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260619 06:41:38.411512 25912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:38.411097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:43121 (local address 127.0.0.1:51844)
0619 06:41:38.411303 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:38.411381 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:43121: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93}
I20260619 06:41:38.441200 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 25772
I20260619 06:41:38.457808 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 25419
I20260619 06:41:38.459110 25482 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:38.574939 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 25419
I20260619 06:41:38.597184 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:37455
--webserver_interface=127.10.192.126
--webserver_port=44119
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:42001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:37455
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:41:38.938647 25948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:38.938964 25948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:38.939069 25948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:38.946614 25948 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:41:38.946753 25948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:38.946801 25948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:38.946853 25948 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:41:38.946898 25948 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:41:38.958231 25948 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:42001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:37455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:37455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=44119
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:38.959623 25948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:38.961076 25948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:38.973682 25956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:38.973737 25954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:38.973737 25953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:38.975003 25948 server_base.cc:1034] running on GCE node
I20260619 06:41:38.976123 25948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:38.977764 25948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:38.979028 25948 hybrid_clock.cc:648] HybridClock initialized: now 1781851298978967 us; error 50 us; skew 500 ppm
I20260619 06:41:38.979408 25948 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:38 dist-test-slave-7lz4 krb5kdc[24868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851298, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:38.982808 25948 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:41:38.984467 25948 webserver.cc:460] Webserver started at http://127.10.192.126:44119/ using document root <none> and password file <none>
I20260619 06:41:38.985262 25948 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:38.985427 25948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:38.991271 25948 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s
I20260619 06:41:38.994573 25963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:38.996548 25948 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260619 06:41:38.996757 25948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "410058977e5947beb4aecb1135b1b606"
format_stamp: "Formatted at 2026-06-19 06:41:32 on dist-test-slave-7lz4"
server_key: "681a9ee15a477c83e0a8840a3e8c3718"
server_key_iv: "5c26a34c173f0d553ba9a1a1ecd7882b"
server_key_version: "encryptionkey@0"
I20260619 06:41:38.997826 25948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:39.010226 25948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:39.015136 25948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:39.015486 25948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:39.035143 25948 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:37455
I20260619 06:41:39.035164 26014 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:37455 every 8 connection(s)
I20260619 06:41:39.036779 25948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:41:39.040207 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 25948
I20260619 06:41:39.041193 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:43121
--local_ip_for_outbound_sockets=127.10.192.65
--tserver_master_addrs=127.10.192.126:37455
--webserver_port=40037
--webserver_interface=127.10.192.65
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:42001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:41:39.045905 26015 sys_catalog.cc:263] Verifying existing consensus state
I20260619 06:41:39.051335 26015 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606: Bootstrap starting.
I20260619 06:41:39.072917 26015 log.cc:824] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:39.089265 26015 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 06:41:39.089968 26015 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606: Bootstrap complete.
I20260619 06:41:39.099150 26015 raft_consensus.cc:348] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "410058977e5947beb4aecb1135b1b606" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37455 } }
I20260619 06:41:39.100229 26015 raft_consensus.cc:729] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 410058977e5947beb4aecb1135b1b606, State: Initialized, Role: FOLLOWER
I20260619 06:41:39.100947 26015 consensus_queue.cc:260] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "410058977e5947beb4aecb1135b1b606" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37455 } }
I20260619 06:41:39.101223 26015 raft_consensus.cc:388] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:41:39.101357 26015 raft_consensus.cc:482] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:41:39.101559 26015 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 2 FOLLOWER]: Advancing to term 3
I20260619 06:41:39.105666 26015 raft_consensus.cc:504] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "410058977e5947beb4aecb1135b1b606" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37455 } }
I20260619 06:41:39.106189 26015 leader_election.cc:302] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 410058977e5947beb4aecb1135b1b606; no voters:
I20260619 06:41:39.106916 26015 leader_election.cc:288] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260619 06:41:39.107080 26019 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 3 FOLLOWER]: Leader election won for term 3
I20260619 06:41:39.108414 26019 raft_consensus.cc:686] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [term 3 LEADER]: Becoming Leader. State: Replica: 410058977e5947beb4aecb1135b1b606, State: Running, Role: LEADER
I20260619 06:41:39.108982 26019 consensus_queue.cc:237] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "410058977e5947beb4aecb1135b1b606" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37455 } }
I20260619 06:41:39.109364 26015 sys_catalog.cc:564] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:41:39.111950 26021 sys_catalog.cc:455] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 410058977e5947beb4aecb1135b1b606. Latest consensus state: current_term: 3 leader_uuid: "410058977e5947beb4aecb1135b1b606" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "410058977e5947beb4aecb1135b1b606" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37455 } } }
I20260619 06:41:39.112076 26020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "410058977e5947beb4aecb1135b1b606" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "410058977e5947beb4aecb1135b1b606" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37455 } } }
I20260619 06:41:39.112432 26020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [sys.catalog]: This master's current role is: LEADER
I20260619 06:41:39.112429 26021 sys_catalog.cc:458] T 00000000000000000000000000000000 P 410058977e5947beb4aecb1135b1b606 [sys.catalog]: This master's current role is: LEADER
I20260619 06:41:39.115343 26026 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:41:39.123015 26026 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:41:39.124795 26026 catalog_manager.cc:1259] Loaded cluster ID: c190ba971e564c9299cbabe65373aef6
I20260619 06:41:39.124910 26026 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260619 06:41:39.126878 26026 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f2aa7b379ad google::LogMessage::Fail() at ??:0
@ 0x7f2aa7b3a88a google::LogMessage::SendToLog() at ??:0
@ 0x7f2aa7b374de google::LogMessage::Flush() at ??:0
@ 0x7f2aa7b38a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f2abd56a512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7f2abd567976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f2abd5ef610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7f2abd5ef439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f2aaa783345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f2aaa78691c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7f2aaa786799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7f2aaa761eaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7f2aada3b6db start_thread at ??:0
@ 0x7f2aa69d161f clone at ??:0
W20260619 06:41:39.441761 26017 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:39.442142 26017 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:39.442404 26017 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:39.450503 26017 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:39.450695 26017 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:39.450954 26017 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:41:39.462277 26017 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:42001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:43121
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=40037
--tserver_master_addrs=127.10.192.126:37455
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:39.463802 26017 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:39.465274 26017 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:39.480199 26056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:39.480211 26057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:39.480191 26059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:39.481056 26017 server_base.cc:1034] running on GCE node
I20260619 06:41:39.481716 26017 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:39.482744 26017 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:39.483945 26017 hybrid_clock.cc:648] HybridClock initialized: now 1781851299483892 us; error 45 us; skew 500 ppm
I20260619 06:41:39.484313 26017 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:39 dist-test-slave-7lz4 krb5kdc[24868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851299, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:39.487567 26017 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:41:39.489337 26017 webserver.cc:460] Webserver started at http://127.10.192.65:40037/ using document root <none> and password file <none>
I20260619 06:41:39.490069 26017 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:39.490206 26017 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:39.496183 26017 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260619 06:41:39.499087 26066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:39.500602 26017 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:41:39.500799 26017 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "a0d586be9de2419aad183a8ad50eb443"
format_stamp: "Formatted at 2026-06-19 06:41:33 on dist-test-slave-7lz4"
server_key: "76ee77cf46d4fb0ff7e051c4ddb51578"
server_key_iv: "22a736aa67511f8f3874819119ff7160"
server_key_version: "encryptionkey@0"
I20260619 06:41:39.501852 26017 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:39.529872 26017 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:39.534675 26017 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:39.534987 26017 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:39.536100 26017 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:41:39.537501 26017 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:41:39.537639 26017 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:39.537778 26017 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:41:39.537873 26017 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:39.571296 26017 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:43121
I20260619 06:41:39.571393 26178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:43121 every 8 connection(s)
I20260619 06:41:39.572849 26017 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:41:39.578090 26181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:39.576218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:51057)
0619 06:41:39.576938 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:39.577193 (+ 255us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":268,"threads_started":1}
W20260619 06:41:39.578990 26179 heartbeater.cc:644] Failed to heartbeat to 127.10.192.126:37455 (0 consecutive failures): Network error: Failed to ping master at 127.10.192.126:37455: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
I20260619 06:41:39.579938 26181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:39.579556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:37367)
0619 06:41:39.579762 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:39.579833 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260619 06:41:39.580334 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 26017
I20260619 06:41:39.580900 26181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:39.580600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:51181)
0619 06:41:39.580725 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:39.580796 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260619 06:41:39.581099 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:33421
--local_ip_for_outbound_sockets=127.10.192.66
--tserver_master_addrs=127.10.192.126:37455
--webserver_port=44977
--webserver_interface=127.10.192.66
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:42001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:41:39.581212 26179 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260619 06:41:39.917073 26182 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:39.917376 26182 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:39.917471 26182 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:39.924870 26182 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:39.924995 26182 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:39.925120 26182 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:41:39.935114 26182 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:42001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:33421
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=44977
--tserver_master_addrs=127.10.192.126:37455
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:39.936523 26182 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:39.937911 26182 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:39.951735 26190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:39.951826 26187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:39.951850 26188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:39.953085 26182 server_base.cc:1034] running on GCE node
I20260619 06:41:39.953763 26182 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:39.954795 26182 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:39.956035 26182 hybrid_clock.cc:648] HybridClock initialized: now 1781851299955962 us; error 58 us; skew 500 ppm
I20260619 06:41:39.956411 26182 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:39 dist-test-slave-7lz4 krb5kdc[24868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851299, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:39.959803 26182 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:41:39.961479 26182 webserver.cc:460] Webserver started at http://127.10.192.66:44977/ using document root <none> and password file <none>
I20260619 06:41:39.962215 26182 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:39.962370 26182 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:39.968092 26182 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260619 06:41:39.971197 26197 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:39.972926 26182 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:41:39.973263 26182 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "402ad02707c8406ea10588a5ef7a254c"
format_stamp: "Formatted at 2026-06-19 06:41:34 on dist-test-slave-7lz4"
server_key: "b844f28660d1c9824e324c2706de4c81"
server_key_iv: "3a678d1cb4cf6fedbde71a0d9a161882"
server_key_version: "encryptionkey@0"
I20260619 06:41:39.974373 26182 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:39.989802 26182 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:39.994768 26182 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:39.995086 26182 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:39.996217 26182 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:41:39.997612 26182 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:41:39.997699 26182 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:39.997871 26182 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:41:39.997956 26182 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:40.032198 26182 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:33421
I20260619 06:41:40.032291 26309 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:33421 every 8 connection(s)
I20260619 06:41:40.033780 26182 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:41:40.035076 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 26182
I20260619 06:41:40.035869 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:34481
--local_ip_for_outbound_sockets=127.10.192.67
--tserver_master_addrs=127.10.192.126:37455
--webserver_port=33471
--webserver_interface=127.10.192.67
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:42001
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:41:40.039574 26312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:40.037463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:51855)
0619 06:41:40.038410 (+ 947us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:40.038651 (+ 241us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":663,"thread_start_us":376,"threads_started":1}
W20260619 06:41:40.040458 26310 heartbeater.cc:644] Failed to heartbeat to 127.10.192.126:37455 (0 consecutive failures): Network error: Failed to ping master at 127.10.192.126:37455: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
I20260619 06:41:40.041460 26312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:40.041081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:33491)
0619 06:41:40.041258 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:40.041351 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260619 06:41:40.042500 26312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:40.042010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:39731)
0619 06:41:40.042217 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:40.042332 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260619 06:41:40.042811 26310 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260619 06:41:40.370903 26313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:40.371273 26313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:40.371374 26313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:40.378933 26313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:40.379091 26313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:40.379280 26313 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:41:40.389865 26313 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:42001
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:34481
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=33471
--tserver_master_addrs=127.10.192.126:37455
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:40.391141 26313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:40.392525 26313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:40.406337 26319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:40.406594 26321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:40.406450 26318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:40.406994 26313 server_base.cc:1034] running on GCE node
I20260619 06:41:40.407732 26313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:40.408687 26313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:40.409896 26313 hybrid_clock.cc:648] HybridClock initialized: now 1781851300409823 us; error 76 us; skew 500 ppm
I20260619 06:41:40.410169 26313 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:40 dist-test-slave-7lz4 krb5kdc[24868](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851300, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:40.413334 26313 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:41:40.414778 26313 webserver.cc:460] Webserver started at http://127.10.192.67:33471/ using document root <none> and password file <none>
I20260619 06:41:40.415437 26313 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:40.415539 26313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:40.420981 26313 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260619 06:41:40.423848 26328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:40.425303 26313 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:41:40.425439 26313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "f819cb11dd424c299e25363ca5c6416b"
format_stamp: "Formatted at 2026-06-19 06:41:34 on dist-test-slave-7lz4"
server_key: "73b8b984464f1013725cf82e1fa4137e"
server_key_iv: "46b777cb677a4b0876c1eac2ac2a2db8"
server_key_version: "encryptionkey@0"
I20260619 06:41:40.426429 26313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:40.468983 26313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:40.473650 26313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:40.473901 26313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:40.474870 26313 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:41:40.476387 26313 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:41:40.476477 26313 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:40.476554 26313 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:41:40.476609 26313 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:40.510227 26313 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:34481
I20260619 06:41:40.510324 26440 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:34481 every 8 connection(s)
I20260619 06:41:40.511961 26313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:41:40.517251 26443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:40.515140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:39417)
0619 06:41:40.515997 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:40.516275 (+ 278us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":304,"threads_started":1}
W20260619 06:41:40.517947 26441 heartbeater.cc:644] Failed to heartbeat to 127.10.192.126:37455 (0 consecutive failures): Network error: Failed to ping master at 127.10.192.126:37455: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
I20260619 06:41:40.518807 26443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:40.518489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:34827)
0619 06:41:40.518626 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:40.518699 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260619 06:41:40.519716 26443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:40.519327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:42385)
0619 06:41:40.519465 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:40.519549 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260619 06:41:40.519943 26441 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260619 06:41:40.521296 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 26313
I20260619 06:41:40.582581 26445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:40.581778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:50947)
0619 06:41:40.582240 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:40.582357 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":212,"threads_started":1}
I20260619 06:41:41.044276 26446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:41.043389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:36161)
0619 06:41:41.043902 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:41.044034 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":282,"threads_started":1}
I20260619 06:41:41.521440 26447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:41.520538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:55723)
0619 06:41:41.521038 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:41.521204 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":244,"threads_started":1}
I20260619 06:41:41.584339 26448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:41.583521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:43789)
0619 06:41:41.584062 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:41.584156 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":309,"threads_started":1}
I20260619 06:41:42.046159 26449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:42.045334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:41595)
0619 06:41:42.045868 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:42.045959 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432,"thread_start_us":260,"threads_started":1}
I20260619 06:41:42.523109 26450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:42.522373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:50833)
0619 06:41:42.522850 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:42.522940 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":242,"threads_started":1}
I20260619 06:41:42.585987 26451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:42.585267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:54597)
0619 06:41:42.585724 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:42.585806 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":234,"threads_started":1}
I20260619 06:41:43.047825 26452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:43.047037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:34005)
0619 06:41:43.047504 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:43.047586 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":265,"threads_started":1}
I20260619 06:41:43.524968 26453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:43.524218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:56671)
0619 06:41:43.524707 (+ 489us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:43.524797 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":260,"threads_started":1}
I20260619 06:41:43.587580 26454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:43.586894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:47833)
0619 06:41:43.587328 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:43.587411 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":332,"thread_start_us":216,"threads_started":1}
I20260619 06:41:44.049479 26455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:44.048750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:34181)
0619 06:41:44.049173 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:44.049257 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":209,"threads_started":1}
I20260619 06:41:44.526631 26456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:44.525902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:57717)
0619 06:41:44.526376 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:44.526462 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":252,"threads_started":1}
I20260619 06:41:44.589408 26457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:44.588685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:38715)
0619 06:41:44.589142 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:44.589221 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":222,"threads_started":1}
I20260619 06:41:45.051733 26458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:45.050709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:56535)
0619 06:41:45.051353 (+ 644us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:45.051485 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":379,"threads_started":1}
I20260619 06:41:45.528394 26459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:45.527680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:41251)
0619 06:41:45.528137 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:45.528224 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":236,"threads_started":1}
I20260619 06:41:45.591513 26460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:45.590552 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:54371)
0619 06:41:45.591240 (+ 688us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:45.591350 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":355,"threads_started":1}
I20260619 06:41:46.053372 26461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:46.052588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:43671)
0619 06:41:46.053122 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:46.053212 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":296,"threads_started":1}
I20260619 06:41:46.530184 26462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:46.529386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:55973)
0619 06:41:46.529928 (+ 542us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:46.530022 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":445,"thread_start_us":247,"threads_started":1}
I20260619 06:41:46.593423 26463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:46.592525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:41327)
0619 06:41:46.593089 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:46.593187 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":434,"thread_start_us":220,"threads_started":1}
I20260619 06:41:47.055253 26464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:47.054383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:35515)
0619 06:41:47.054934 (+ 551us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:47.055027 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":248,"threads_started":1}
I20260619 06:41:47.532148 26465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:47.531235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:46559)
0619 06:41:47.531838 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:47.531937 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":236,"threads_started":1}
I20260619 06:41:47.595109 26466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:47.594375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:36231)
0619 06:41:47.594859 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:47.594946 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":245,"threads_started":1}
I20260619 06:41:48.056916 26467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:48.056222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:51525)
0619 06:41:48.056650 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:48.056738 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":328,"thread_start_us":212,"threads_started":1}
I20260619 06:41:48.533887 26468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:48.533119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:43307)
0619 06:41:48.533587 (+ 468us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:48.533691 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":238,"threads_started":1}
I20260619 06:41:48.597026 26469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:48.596208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:42205)
0619 06:41:48.596749 (+ 541us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:48.596841 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":245,"threads_started":1}
I20260619 06:41:49.058594 26470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:49.057854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:58487)
0619 06:41:49.058326 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:49.058414 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":219,"threads_started":1}
I20260619 06:41:49.535602 26471 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:49.534848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:50277)
0619 06:41:49.535325 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:49.535423 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":224,"threads_started":1}
I20260619 06:41:49.599134 26472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:49.598147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:44413)
0619 06:41:49.598857 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:49.598951 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":417,"threads_started":1}
I20260619 06:41:50.060529 26473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:50.059785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:42059)
0619 06:41:50.060266 (+ 481us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:50.060359 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":246,"threads_started":1}
I20260619 06:41:50.538167 26474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:50.536748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:36617)
0619 06:41:50.537884 (+ 1136us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:50.537986 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1014,"thread_start_us":890,"threads_started":1}
I20260619 06:41:50.601082 26475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:50.600288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:35727)
0619 06:41:50.600788 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:50.600896 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":393,"thread_start_us":240,"threads_started":1}
I20260619 06:41:51.062287 26476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:51.061539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:42695)
0619 06:41:51.061998 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:51.062099 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":357,"thread_start_us":231,"threads_started":1}
I20260619 06:41:51.540151 26477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:51.539231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:35095)
0619 06:41:51.539861 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:51.539965 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":328,"threads_started":1}
I20260619 06:41:51.602741 26478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:51.602063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:49751)
0619 06:41:51.602498 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:51.602585 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":224,"threads_started":1}
I20260619 06:41:52.064356 26479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:52.063423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:41825)
0619 06:41:52.064047 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:52.064152 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":366,"threads_started":1}
I20260619 06:41:52.541908 26480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:52.541103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:56047)
0619 06:41:52.541607 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:52.541729 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":326,"thread_start_us":226,"threads_started":1}
I20260619 06:41:52.604636 26481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:52.603833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:49065)
0619 06:41:52.604333 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:52.604439 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":228,"threads_started":1}
I20260619 06:41:53.066176 26482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:53.065367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:53009)
0619 06:41:53.065876 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:53.065980 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":232,"threads_started":1}
I20260619 06:41:53.543911 26483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:53.542943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:44695)
0619 06:41:53.543437 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:53.543538 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":242,"threads_started":1}
I20260619 06:41:53.606515 26484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:53.605725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:41433)
0619 06:41:53.606242 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:53.606331 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":404,"thread_start_us":263,"threads_started":1}
I20260619 06:41:54.067983 26485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:54.067174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:39991)
0619 06:41:54.067719 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:54.067799 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":286,"threads_started":1}
I20260619 06:41:54.545717 26486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:54.544919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:41623)
0619 06:41:54.545429 (+ 510us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:54.545531 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":399,"thread_start_us":284,"threads_started":1}
I20260619 06:41:54.608657 26487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:54.607809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:41945)
0619 06:41:54.608280 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:54.608404 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":240,"threads_started":1}
I20260619 06:41:55.070068 26488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:55.069192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.66:54895)
0619 06:41:55.069766 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:55.069877 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":330,"threads_started":1}
I20260619 06:41:55.524183 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 26017
I20260619 06:41:55.543817 26489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:55.525418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39800 (local address 127.10.192.65:43121)
0619 06:41:55.526261 (+ 843us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:55.526275 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:55.526362 (+ 87us) server_negotiation.cc:407] Connection header received
0619 06:41:55.528606 (+ 2244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:55.528617 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:55.529064 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:55.529375 (+ 311us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:55.530965 (+ 1590us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:55.532449 (+ 1484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:55.533736 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:55.534431 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:55.534585 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:55.537358 (+ 2773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:55.537368 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:55.537386 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:55.537431 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:55.540617 (+ 3186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:55.541317 (+ 700us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:55.541324 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:55.541332 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:55.541508 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:55.541840 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:55.541843 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:55.541845 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:55.542384 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:55.542620 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:55.543013 (+ 393us) server_negotiation.cc:299] Negotiation successful
0619 06:41:55.543468 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":534,"threads_started":1}
I20260619 06:41:55.545310 26174 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:55.548051 26491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:55.547132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.67:50875)
0619 06:41:55.547697 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:55.547818 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":285,"threads_started":1}
I20260619 06:41:55.634735 26492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:55.633529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:37455 (local address 127.10.192.65:46077)
0619 06:41:55.634149 (+ 620us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:55.634396 (+ 247us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:37455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":269,"threads_started":1}
I20260619 06:41:55.635820 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 26017
I20260619 06:41:55.654557 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 26182
I20260619 06:41:55.674258 26493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:55.655730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45060 (local address 127.10.192.66:33421)
0619 06:41:55.656309 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:55.656324 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:55.656361 (+ 37us) server_negotiation.cc:407] Connection header received
0619 06:41:55.657975 (+ 1614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:55.657985 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:55.658452 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:55.658832 (+ 380us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:55.660508 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:55.661798 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:55.663241 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:55.664047 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:55.664280 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:55.667256 (+ 2976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:55.667265 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:55.667284 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:55.667329 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:55.670465 (+ 3136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:55.671356 (+ 891us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:55.671365 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:55.671372 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:55.671575 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:55.672059 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:55.672064 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:55.672067 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:55.672640 (+ 573us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:55.672980 (+ 340us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:55.673479 (+ 499us) server_negotiation.cc:299] Negotiation successful
0619 06:41:55.673939 (+ 460us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":275,"threads_started":1}
I20260619 06:41:55.675778 26305 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:55.763000 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 26182
I20260619 06:41:55.782606 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 26313
I20260619 06:41:55.801432 26495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:55.783872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37714 (local address 127.10.192.67:34481)
0619 06:41:55.784561 (+ 689us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:55.784576 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:55.784617 (+ 41us) server_negotiation.cc:407] Connection header received
0619 06:41:55.786336 (+ 1719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:55.786347 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:55.786796 (+ 449us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:55.787105 (+ 309us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:55.788540 (+ 1435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:55.789813 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:55.791135 (+ 1322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:55.791987 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:55.792127 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:55.795023 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:55.795031 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:55.795049 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:55.795099 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:55.798234 (+ 3135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:55.798980 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:55.798987 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:55.798994 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:55.799185 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:55.799523 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:55.799526 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:55.799528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:55.800167 (+ 639us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:55.800407 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:55.800748 (+ 341us) server_negotiation.cc:299] Negotiation successful
0619 06:41:55.801097 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":509,"thread_start_us":373,"threads_started":1}
I20260619 06:41:55.802973 26436 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:55.889364 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 26313
2026-06-19T06:41:55Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (24636 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:41:55 dist-test-slave-7lz4 krb5kdc[26499](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:41:55 dist-test-slave-7lz4 krb5kdc[26499](info): set up 2 sockets
Jun 19 06:41:55 dist-test-slave-7lz4 krb5kdc[26499](info): commencing operation
krb5kdc: starting...
W20260619 06:41:57.008322 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.001s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:41:57 dist-test-slave-7lz4 krb5kdc[26499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:41:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:41:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:41:57.259235 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:35779
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:41323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:35779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:41:57.602973 26512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:57.603298 26512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:57.603483 26512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:57.611090 26512 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260619 06:41:57.611207 26512 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260619 06:41:57.611281 26512 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260619 06:41:57.611362 26512 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:41:57.611462 26512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:57.611583 26512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:57.611701 26512 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:41:57.611784 26512 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:41:57.622182 26512 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:41323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:35779
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:35779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:57.623682 26512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:57.625142 26512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:57.637997 26518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:57.638080 26520 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:57.638080 26517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:57.638888 26512 server_base.cc:1034] running on GCE node
I20260619 06:41:57.639839 26512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:57.641414 26512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:57.642691 26512 hybrid_clock.cc:648] HybridClock initialized: now 1781851317642614 us; error 51 us; skew 500 ppm
I20260619 06:41:57.643060 26512 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:57 dist-test-slave-7lz4 krb5kdc[26499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851317, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:57.646345 26512 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:41:57.648087 26512 webserver.cc:460] Webserver started at http://127.10.192.126:35325/ using document root <none> and password file <none>
I20260619 06:41:57.648851 26512 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:57.648991 26512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:57.649346 26512 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:41:57.652606 26512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "1628f24adb7b4063b4b59fbfcec676ef"
format_stamp: "Formatted at 2026-06-19 06:41:57 on dist-test-slave-7lz4"
server_key: "d175e49792b2938c59b87d2410299694"
server_key_iv: "34e59f47fb1903e8743a522cab651a49"
server_key_version: "encryptionkey@0"
I20260619 06:41:57.653574 26512 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "1628f24adb7b4063b4b59fbfcec676ef"
format_stamp: "Formatted at 2026-06-19 06:41:57 on dist-test-slave-7lz4"
server_key: "d175e49792b2938c59b87d2410299694"
server_key_iv: "34e59f47fb1903e8743a522cab651a49"
server_key_version: "encryptionkey@0"
I20260619 06:41:57.659128 26512 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 06:41:57.662967 26527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:57.664561 26512 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:41:57.664773 26512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "1628f24adb7b4063b4b59fbfcec676ef"
format_stamp: "Formatted at 2026-06-19 06:41:57 on dist-test-slave-7lz4"
server_key: "d175e49792b2938c59b87d2410299694"
server_key_iv: "34e59f47fb1903e8743a522cab651a49"
server_key_version: "encryptionkey@0"
I20260619 06:41:57.665043 26512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:57.685343 26512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:57.689838 26512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:57.690164 26512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:57.709656 26512 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:35779
I20260619 06:41:57.709697 26578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:35779 every 8 connection(s)
I20260619 06:41:57.711176 26512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:41:57.713815 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 26512
I20260619 06:41:57.714072 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:41:57.714921 11009 external_mini_cluster.cc:1428] Setting key fb5fcebdb898b9a67392570e3a03bcbe
I20260619 06:41:57.716133 26579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Jun 19 06:41:57 dist-test-slave-7lz4 krb5kdc[26499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:57.731639 26579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef: Bootstrap starting.
I20260619 06:41:57.735500 26579 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef: Neither blocks nor log segments found. Creating new log.
I20260619 06:41:57.736898 26579 log.cc:824] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:57.740432 26579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef: No bootstrap required, opened a new log
I20260619 06:41:57.740784 26582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:57.717144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45234 (local address 127.10.192.126:35779)
0619 06:41:57.717994 (+ 850us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:57.718008 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:57.718053 (+ 45us) server_negotiation.cc:407] Connection header received
0619 06:41:57.719726 (+ 1673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:57.719751 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:57.720193 (+ 442us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:57.720607 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:57.722492 (+ 1885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:57.723972 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:57.725892 (+ 1920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:57.726718 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:57.726897 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:57.732708 (+ 5811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:57.732717 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:57.732733 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:57.732774 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:57.736080 (+ 3306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:57.737087 (+ 1007us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:57.737098 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:57.737110 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:57.737307 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:57.737838 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:57.737848 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:57.737857 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:57.738592 (+ 735us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:57.738808 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:57.739299 (+ 491us) server_negotiation.cc:299] Negotiation successful
0619 06:41:57.739697 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":632,"thread_start_us":401,"threads_started":1}
I20260619 06:41:57.748497 26579 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1628f24adb7b4063b4b59fbfcec676ef" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35779 } }
I20260619 06:41:57.748916 26579 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:41:57.749060 26579 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1628f24adb7b4063b4b59fbfcec676ef, State: Initialized, Role: FOLLOWER
I20260619 06:41:57.749873 26579 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1628f24adb7b4063b4b59fbfcec676ef" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35779 } }
I20260619 06:41:57.750180 26584 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:41:57.750432 26584 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1628f24adb7b4063b4b59fbfcec676ef" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35779 } }
I20260619 06:41:57.751005 26584 leader_election.cc:302] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1628f24adb7b4063b4b59fbfcec676ef; no voters:
I20260619 06:41:57.751752 26584 leader_election.cc:288] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers
I20260619 06:41:57.751937 26585 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:41:57.752146 26585 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:41:57.752313 26585 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:41:57.754839 26585 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1628f24adb7b4063b4b59fbfcec676ef" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35779 } }
I20260619 06:41:57.755134 26585 leader_election.cc:302] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1628f24adb7b4063b4b59fbfcec676ef; no voters:
I20260619 06:41:57.751880 26579 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:41:57.755347 26585 leader_election.cc:288] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:41:57.755424 26584 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:41:57.755587 26584 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 1 LEADER]: Becoming Leader. State: Replica: 1628f24adb7b4063b4b59fbfcec676ef, State: Running, Role: LEADER
I20260619 06:41:57.756115 26584 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1628f24adb7b4063b4b59fbfcec676ef" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35779 } }
I20260619 06:41:57.757628 26579 raft_consensus.cc:465] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 1 LEADER]: Not starting leader election -- already a leader
I20260619 06:41:57.758191 26584 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1628f24adb7b4063b4b59fbfcec676ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1628f24adb7b4063b4b59fbfcec676ef" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35779 } } }
I20260619 06:41:57.758279 26585 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1628f24adb7b4063b4b59fbfcec676ef. Latest consensus state: current_term: 1 leader_uuid: "1628f24adb7b4063b4b59fbfcec676ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1628f24adb7b4063b4b59fbfcec676ef" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35779 } } }
I20260619 06:41:57.758590 26584 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [sys.catalog]: This master's current role is: LEADER
I20260619 06:41:57.758667 26585 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [sys.catalog]: This master's current role is: LEADER
I20260619 06:41:57.759755 26579 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:41:57.761226 26587 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:41:57.766589 26587 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:41:57.777263 26587 catalog_manager.cc:1347] Generated new cluster ID: 110fcb7b919e4f33a137a3e7e0087b1d
I20260619 06:41:57.777415 26587 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:41:57.795009 26587 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:41:57.796442 26587 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:41:57.811564 26587 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef: Generated new TSK 0
I20260619 06:41:57.812765 26587 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
I20260619 06:41:57.888283 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:35779
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:41323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:41:58.240424 26604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:58.240720 26604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:58.240815 26604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:58.248468 26604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:58.248592 26604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:58.248706 26604 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:41:58.258972 26604 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:41323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:35779
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:58.260637 26604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:58.262168 26604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:58.276188 26609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:58.276255 26610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:58.276232 26612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:58.277053 26604 server_base.cc:1034] running on GCE node
I20260619 06:41:58.277753 26604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:58.278764 26604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:58.280014 26604 hybrid_clock.cc:648] HybridClock initialized: now 1781851318279945 us; error 52 us; skew 500 ppm
I20260619 06:41:58.280368 26604 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:58 dist-test-slave-7lz4 krb5kdc[26499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851318, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:58.283784 26604 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:41:58.285388 26604 webserver.cc:460] Webserver started at http://127.10.192.65:33537/ using document root <none> and password file <none>
I20260619 06:41:58.286144 26604 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:58.286298 26604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:58.286621 26604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:41:58.289738 26604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "74f0abc397fe40bd905878ebee32b2f6"
format_stamp: "Formatted at 2026-06-19 06:41:58 on dist-test-slave-7lz4"
server_key: "5184d01f360eec82fa86089ed9ec32f5"
server_key_iv: "dfe1417daaf034ec9f6bf74452355a9c"
server_key_version: "encryptionkey@0"
I20260619 06:41:58.290580 26604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "74f0abc397fe40bd905878ebee32b2f6"
format_stamp: "Formatted at 2026-06-19 06:41:58 on dist-test-slave-7lz4"
server_key: "5184d01f360eec82fa86089ed9ec32f5"
server_key_iv: "dfe1417daaf034ec9f6bf74452355a9c"
server_key_version: "encryptionkey@0"
I20260619 06:41:58.296278 26604 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 06:41:58.300017 26619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:58.301502 26604 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:41:58.301698 26604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "74f0abc397fe40bd905878ebee32b2f6"
format_stamp: "Formatted at 2026-06-19 06:41:58 on dist-test-slave-7lz4"
server_key: "5184d01f360eec82fa86089ed9ec32f5"
server_key_iv: "dfe1417daaf034ec9f6bf74452355a9c"
server_key_version: "encryptionkey@0"
I20260619 06:41:58.301911 26604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:58.330713 26604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:58.335597 26604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:58.335988 26604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:58.337039 26604 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:41:58.338541 26604 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:41:58.338647 26604 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:58.338804 26604 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:41:58.338882 26604 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:58.373171 26604 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:32887
I20260619 06:41:58.373210 26731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:32887 every 8 connection(s)
I20260619 06:41:58.374516 26604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:41:58.376422 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 26604
I20260619 06:41:58.376655 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:41:58.377521 11009 external_mini_cluster.cc:1428] Setting key 7baefa351c24c6a8d0ac22b4f3c618df
Jun 19 06:41:58 dist-test-slave-7lz4 krb5kdc[26499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851318, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:58.397037 26734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:58.377409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:52975 (local address 127.10.192.126:35779)
0619 06:41:58.377905 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:58.377910 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:58.379152 (+ 1242us) server_negotiation.cc:407] Connection header received
0619 06:41:58.381120 (+ 1968us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:58.381129 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:58.381221 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:58.381343 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:58.382851 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:58.384028 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:58.385629 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:58.386365 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:58.386513 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:58.390710 (+ 4197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:58.390715 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:58.390719 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:58.390755 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:58.393429 (+ 2674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:58.394534 (+ 1105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:58.394538 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:58.394540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:58.394673 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:58.395194 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:58.395197 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:58.395199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:58.395477 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:58.395588 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:58.396580 (+ 992us) server_negotiation.cc:299] Negotiation successful
0619 06:41:58.396775 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":283,"threads_started":1}
I20260619 06:41:58.398810 26735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:58.378088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:52975)
0619 06:41:58.378955 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:58.379014 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:58.380836 (+ 1822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:58.381555 (+ 719us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:58.381563 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:58.382078 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:58.382673 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:58.382691 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:58.384183 (+ 1492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:58.384186 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:58.385455 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:58.385466 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:58.386609 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:58.386614 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:58.386829 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:58.387608 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:58.387724 (+ 116us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:58.390413 (+ 2689us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:58.393601 (+ 3188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:58.393614 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:58.393638 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:58.394402 (+ 764us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:58.394785 (+ 383us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:58.394792 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:58.394798 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:58.395087 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:58.395611 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:58.395623 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:58.396142 (+ 519us) client_negotiation.cc:769] Sending connection context
0619 06:41:58.396489 (+ 347us) client_negotiation.cc:240] Negotiation successful
0619 06:41:58.397137 (+ 648us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":318,"threads_started":1}
I20260619 06:41:58.400619 26732 heartbeater.cc:347] Connected to a master server at 127.10.192.126:35779
I20260619 06:41:58.401006 26732 heartbeater.cc:464] Registering TS with master...
I20260619 06:41:58.401952 26732 heartbeater.cc:511] Master 127.10.192.126:35779 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.192.66@KRBTEST.COM; defaulting to no policy
I20260619 06:41:58.404419 26544 ts_manager.cc:194] Registered new tserver with Master: 74f0abc397fe40bd905878ebee32b2f6 (127.10.192.65:32887)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.66@KRBTEST.COM" created.
I20260619 06:41:58.406198 26544 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:52975
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
I20260619 06:41:58.433233 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:35779
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:41323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:41:58.775592 26738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:58.775981 26738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:58.776170 26738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:58.783882 26738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:58.784052 26738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:58.784242 26738 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:41:58.794380 26738 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:41323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:35779
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:58.795782 26738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:58.797173 26738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:58.810847 26746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:58.810909 26744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:58.811419 26743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:58.811769 26738 server_base.cc:1034] running on GCE node
I20260619 06:41:58.812456 26738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:58.813482 26738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:58.814721 26738 hybrid_clock.cc:648] HybridClock initialized: now 1781851318814665 us; error 61 us; skew 500 ppm
I20260619 06:41:58.815053 26738 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:58 dist-test-slave-7lz4 krb5kdc[26499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851318, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:58.823812 26738 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:41:58.825457 26738 webserver.cc:460] Webserver started at http://127.10.192.66:33379/ using document root <none> and password file <none>
I20260619 06:41:58.826260 26738 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:58.826442 26738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:58.826778 26738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:41:58.830087 26738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "76c633bb0e70489390ae5d27460d29ac"
format_stamp: "Formatted at 2026-06-19 06:41:58 on dist-test-slave-7lz4"
server_key: "6ff8527fc1175b50de07aec4701a962a"
server_key_iv: "1b3191ef1e9390840b84367a7e4ec3af"
server_key_version: "encryptionkey@0"
I20260619 06:41:58.830981 26738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "76c633bb0e70489390ae5d27460d29ac"
format_stamp: "Formatted at 2026-06-19 06:41:58 on dist-test-slave-7lz4"
server_key: "6ff8527fc1175b50de07aec4701a962a"
server_key_iv: "1b3191ef1e9390840b84367a7e4ec3af"
server_key_version: "encryptionkey@0"
I20260619 06:41:58.836962 26738 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260619 06:41:58.840726 26753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:58.842157 26738 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:41:58.842350 26738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "76c633bb0e70489390ae5d27460d29ac"
format_stamp: "Formatted at 2026-06-19 06:41:58 on dist-test-slave-7lz4"
server_key: "6ff8527fc1175b50de07aec4701a962a"
server_key_iv: "1b3191ef1e9390840b84367a7e4ec3af"
server_key_version: "encryptionkey@0"
I20260619 06:41:58.842576 26738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:58.858474 26738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:58.863269 26738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:58.863586 26738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:58.864675 26738 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:41:58.866074 26738 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:41:58.866185 26738 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:58.866339 26738 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:41:58.866418 26738 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:58.901719 26738 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:40079
I20260619 06:41:58.901760 26865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:40079 every 8 connection(s)
I20260619 06:41:58.903185 26738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:41:58.908084 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 26738
I20260619 06:41:58.908299 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:41:58.908798 11009 external_mini_cluster.cc:1428] Setting key 45d27855eb3d717af42d84ee5a30bc00
Jun 19 06:41:58 dist-test-slave-7lz4 krb5kdc[26499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851318, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:58.925498 26868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:58.905917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:48467 (local address 127.10.192.126:35779)
0619 06:41:58.906362 (+ 445us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:58.906367 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:58.907434 (+ 1067us) server_negotiation.cc:407] Connection header received
0619 06:41:58.909596 (+ 2162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:58.909601 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:58.909710 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:58.909844 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:58.911460 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:58.912251 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:58.913861 (+ 1610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:58.914295 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:58.914432 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:58.918195 (+ 3763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:58.918200 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:58.918204 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:58.918241 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:58.921759 (+ 3518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:58.922654 (+ 895us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:58.922664 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:58.922670 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:58.922841 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:58.923293 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:58.923300 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:58.923306 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:58.923765 (+ 459us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:58.923930 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:58.924675 (+ 745us) server_negotiation.cc:299] Negotiation successful
0619 06:41:58.924959 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":338,"thread_start_us":237,"threads_started":1}
I20260619 06:41:58.926206 26869 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:58.906483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:48467)
0619 06:41:58.907254 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:58.907300 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:58.909262 (+ 1962us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:58.910100 (+ 838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:58.910110 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:58.910667 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:58.911283 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:58.911301 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:58.912411 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:58.912415 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:58.913709 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:58.913722 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:58.914531 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:58.914539 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:58.914799 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:58.915555 (+ 756us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:58.915579 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:58.917917 (+ 2338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:58.921964 (+ 4047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:58.921972 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:58.921987 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:58.922505 (+ 518us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:58.922961 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:58.922965 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:58.922967 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:58.923181 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:58.923893 (+ 712us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:58.923900 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:58.924290 (+ 390us) client_negotiation.cc:769] Sending connection context
0619 06:41:58.924539 (+ 249us) client_negotiation.cc:240] Negotiation successful
0619 06:41:58.924970 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":536,"thread_start_us":304,"threads_started":1}
I20260619 06:41:58.927896 26866 heartbeater.cc:347] Connected to a master server at 127.10.192.126:35779
I20260619 06:41:58.928277 26866 heartbeater.cc:464] Registering TS with master...
I20260619 06:41:58.929226 26866 heartbeater.cc:511] Master 127.10.192.126:35779 requested a full tablet report, sending...
I20260619 06:41:58.931046 26544 ts_manager.cc:194] Registered new tserver with Master: 76c633bb0e70489390ae5d27460d29ac (127.10.192.66:40079)
I20260619 06:41:58.931998 26544 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:48467
WARNING: no policy specified for kudu/127.10.192.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
I20260619 06:41:58.965034 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:35779
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:41323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:41:59.293898 26872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:41:59.294185 26872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:41:59.294358 26872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:41:59.301972 26872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:41:59.302103 26872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:41:59.302312 26872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:41:59.312669 26872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:41323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:35779
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:41:59.314126 26872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:41:59.315505 26872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:41:59.329268 26878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:59.329290 26880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:41:59.329190 26877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:41:59.330123 26872 server_base.cc:1034] running on GCE node
I20260619 06:41:59.330722 26872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:41:59.331836 26872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:41:59.333045 26872 hybrid_clock.cc:648] HybridClock initialized: now 1781851319332987 us; error 50 us; skew 500 ppm
I20260619 06:41:59.333389 26872 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:41:59 dist-test-slave-7lz4 krb5kdc[26499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851319, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:41:59.337193 26872 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:41:59.338861 26872 webserver.cc:460] Webserver started at http://127.10.192.67:45191/ using document root <none> and password file <none>
I20260619 06:41:59.339612 26872 fs_manager.cc:359] Metadata directory not provided
I20260619 06:41:59.339830 26872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:41:59.340170 26872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:41:59.343279 26872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "c4caf8fdb029435982a4656f51e6c3dd"
format_stamp: "Formatted at 2026-06-19 06:41:59 on dist-test-slave-7lz4"
server_key: "ba19e8c0fd2c597f501ccc21b97f819e"
server_key_iv: "b036f261cb3aff0c69dcec151c72fd03"
server_key_version: "encryptionkey@0"
I20260619 06:41:59.344146 26872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "c4caf8fdb029435982a4656f51e6c3dd"
format_stamp: "Formatted at 2026-06-19 06:41:59 on dist-test-slave-7lz4"
server_key: "ba19e8c0fd2c597f501ccc21b97f819e"
server_key_iv: "b036f261cb3aff0c69dcec151c72fd03"
server_key_version: "encryptionkey@0"
I20260619 06:41:59.349721 26872 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260619 06:41:59.353440 26887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:59.354880 26872 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 06:41:59.355077 26872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "c4caf8fdb029435982a4656f51e6c3dd"
format_stamp: "Formatted at 2026-06-19 06:41:59 on dist-test-slave-7lz4"
server_key: "ba19e8c0fd2c597f501ccc21b97f819e"
server_key_iv: "b036f261cb3aff0c69dcec151c72fd03"
server_key_version: "encryptionkey@0"
I20260619 06:41:59.355290 26872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:41:59.373342 26872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:41:59.379551 26872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:41:59.379961 26872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:41:59.381275 26872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:41:59.383070 26872 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:41:59.383201 26872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:59.383347 26872 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:41:59.383414 26872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:41:59.409453 26732 heartbeater.cc:503] Master 127.10.192.126:35779 was elected leader, sending a full tablet report...
I20260619 06:41:59.416455 26872 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:38099
I20260619 06:41:59.416496 26999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:38099 every 8 connection(s)
I20260619 06:41:59.417826 26872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:41:59.419397 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 26872
I20260619 06:41:59.419554 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:41:59.420156 11009 external_mini_cluster.cc:1428] Setting key 9033c2ead70673557a36e60b9355abb4
Jun 19 06:41:59 dist-test-slave-7lz4 krb5kdc[26499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851319, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:41:59.439208 26868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.421331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:40879 (local address 127.10.192.126:35779)
0619 06:41:59.421536 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:59.421540 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:59.422988 (+ 1448us) server_negotiation.cc:407] Connection header received
0619 06:41:59.425035 (+ 2047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:59.425040 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:59.425153 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:59.425262 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:59.426808 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.427544 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.429153 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.429564 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.429698 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:59.433263 (+ 3565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:59.433268 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:59.433272 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:59.433307 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:59.436520 (+ 3213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:59.437235 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:59.437238 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:59.437241 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:59.437366 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:59.437760 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:59.437763 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:59.437765 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:59.438023 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:59.438147 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:59.438793 (+ 646us) server_negotiation.cc:299] Negotiation successful
0619 06:41:59.438980 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 06:41:59.440316 27002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.422010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:40879)
0619 06:41:59.422848 (+ 838us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:59.422887 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:59.424769 (+ 1882us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:59.425507 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:59.425516 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:59.426025 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:41:59.426636 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:59.426662 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.427738 (+ 1076us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.427757 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:59.428996 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:59.429008 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.429797 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.429805 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:59.430045 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:59.430757 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:41:59.430783 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:41:59.433035 (+ 2252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:41:59.436661 (+ 3626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:59.436668 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:59.436684 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:59.437124 (+ 440us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:59.437460 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:41:59.437463 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:41:59.437465 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:41:59.437654 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:41:59.438124 (+ 470us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:41:59.438130 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:41:59.438470 (+ 340us) client_negotiation.cc:769] Sending connection context
0619 06:41:59.438709 (+ 239us) client_negotiation.cc:240] Negotiation successful
0619 06:41:59.439106 (+ 397us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":343,"threads_started":1}
I20260619 06:41:59.441709 27000 heartbeater.cc:347] Connected to a master server at 127.10.192.126:35779
I20260619 06:41:59.442013 27000 heartbeater.cc:464] Registering TS with master...
I20260619 06:41:59.442763 27000 heartbeater.cc:511] Master 127.10.192.126:35779 requested a full tablet report, sending...
I20260619 06:41:59.444173 26544 ts_manager.cc:194] Registered new tserver with Master: c4caf8fdb029435982a4656f51e6c3dd (127.10.192.67:38099)
I20260619 06:41:59.444949 26544 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:40879
I20260619 06:41:59.448732 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 06:41:59.466355 26868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.453088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45246 (local address 127.10.192.126:35779)
0619 06:41:59.453310 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:59.453318 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:59.453702 (+ 384us) server_negotiation.cc:407] Connection header received
0619 06:41:59.453915 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:59.453920 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:59.453984 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:59.454090 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:59.455574 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.456389 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.457946 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.458377 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.458522 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:59.461170 (+ 2648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:59.461176 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:59.461179 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:59.461214 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:59.463858 (+ 2644us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:59.464605 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:59.464609 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:59.464611 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:59.464750 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:59.465118 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:59.465120 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:59.465122 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:59.465446 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:59.465640 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:59.465926 (+ 286us) server_negotiation.cc:299] Negotiation successful
0619 06:41:59.466098 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260619 06:41:59.470885 26544 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45246:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:41:59.477896 26544 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:41:59.514561 27015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.491090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55056 (local address 127.10.192.67:38099)
0619 06:41:59.503483 (+ 12393us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:59.503498 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:59.505332 (+ 1834us) server_negotiation.cc:407] Connection header received
0619 06:41:59.506475 (+ 1143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:59.506486 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:59.506810 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:59.507010 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:59.507937 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.509483 (+ 1546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.511829 (+ 2346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.513277 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.513423 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:59.513707 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:59.513998 (+ 291us) server_negotiation.cc:299] Negotiation successful
0619 06:41:59.514189 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12105,"thread_start_us":12364,"threads_started":1}
I20260619 06:41:59.515300 27017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.505608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59180 (local address 127.10.192.66:40079)
0619 06:41:59.506254 (+ 646us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:59.506264 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:59.506293 (+ 29us) server_negotiation.cc:407] Connection header received
0619 06:41:59.506528 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:59.506535 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:59.506789 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:59.506967 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:59.507570 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.508952 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.512203 (+ 3251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.513623 (+ 1420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.513770 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:59.513971 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:59.514806 (+ 835us) server_negotiation.cc:299] Negotiation successful
0619 06:41:59.514982 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":388,"threads_started":1}
I20260619 06:41:59.515400 27012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.490476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:38099 (local address 127.0.0.1:55056)
0619 06:41:59.505213 (+ 14737us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:59.505233 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:59.506224 (+ 991us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:59.507227 (+ 1003us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:59.507231 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:59.507262 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:59.507738 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:59.507751 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.509665 (+ 1914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.509670 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:59.511614 (+ 1944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:59.511674 (+ 60us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.513470 (+ 1796us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.513474 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:59.513692 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:59.513760 (+ 68us) client_negotiation.cc:769] Sending connection context
0619 06:41:59.514809 (+ 1049us) client_negotiation.cc:240] Negotiation successful
0619 06:41:59.514982 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14597,"mutex_wait_us":5,"thread_start_us":13481,"threads_started":1}
I20260619 06:41:59.516259 27016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.505394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:40079 (local address 127.0.0.1:59180)
0619 06:41:59.505997 (+ 603us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:59.506016 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:59.506319 (+ 303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:59.506974 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:59.506978 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:59.507003 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:59.507406 (+ 403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:59.507416 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.509127 (+ 1711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.509131 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:59.512037 (+ 2906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:59.512046 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.514233 (+ 2187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.514239 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:59.514435 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:59.514466 (+ 31us) client_negotiation.cc:769] Sending connection context
0619 06:41:59.514562 (+ 96us) client_negotiation.cc:240] Negotiation successful
0619 06:41:59.515856 (+ 1294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"mutex_wait_us":165,"spinlock_wait_cycles":374144,"thread_start_us":344,"threads_started":1}
I20260619 06:41:59.516366 27014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.490174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:32887 (local address 127.0.0.1:45458)
0619 06:41:59.504383 (+ 14209us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:59.504424 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:59.504616 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:59.506022 (+ 1406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:59.506030 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:59.506246 (+ 216us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:59.506732 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:59.506747 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.509070 (+ 2323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.509075 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:59.512014 (+ 2939us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:59.512034 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.515487 (+ 3453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.515493 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:59.515685 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:59.515714 (+ 29us) client_negotiation.cc:769] Sending connection context
0619 06:41:59.515796 (+ 82us) client_negotiation.cc:240] Negotiation successful
0619 06:41:59.515935 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13947,"mutex_wait_us":105,"spinlock_wait_cycles":368384,"thread_start_us":14757,"threads_started":1}
I20260619 06:41:59.516651 27013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.490364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45458 (local address 127.10.192.65:32887)
0619 06:41:59.505239 (+ 14875us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:59.505250 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:59.505282 (+ 32us) server_negotiation.cc:407] Connection header received
0619 06:41:59.505402 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:59.505411 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:59.505708 (+ 297us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:59.506923 (+ 1215us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:59.507215 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.508916 (+ 1701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.513827 (+ 4911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.515263 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.515428 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:59.516020 (+ 592us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:59.516104 (+ 84us) server_negotiation.cc:299] Negotiation successful
0619 06:41:59.516269 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14685,"thread_start_us":14519,"threads_started":1}
I20260619 06:41:59.519742 26667 tablet_service.cc:1467] Processing CreateTablet for tablet bff8dc7b374b446c87e8cebab4b2e54c (DEFAULT_TABLE table=test-table [id=814bc602c3664fa189a7a16bd9c4022b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:41:59.519829 26935 tablet_service.cc:1467] Processing CreateTablet for tablet bff8dc7b374b446c87e8cebab4b2e54c (DEFAULT_TABLE table=test-table [id=814bc602c3664fa189a7a16bd9c4022b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:41:59.519829 26801 tablet_service.cc:1467] Processing CreateTablet for tablet bff8dc7b374b446c87e8cebab4b2e54c (DEFAULT_TABLE table=test-table [id=814bc602c3664fa189a7a16bd9c4022b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:41:59.521067 26667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bff8dc7b374b446c87e8cebab4b2e54c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:41:59.521196 26935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bff8dc7b374b446c87e8cebab4b2e54c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:41:59.521209 26801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bff8dc7b374b446c87e8cebab4b2e54c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:41:59.533293 27018 tablet_bootstrap.cc:492] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6: Bootstrap starting.
I20260619 06:41:59.536661 27020 tablet_bootstrap.cc:492] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac: Bootstrap starting.
I20260619 06:41:59.537191 27018 tablet_bootstrap.cc:654] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6: Neither blocks nor log segments found. Creating new log.
I20260619 06:41:59.538029 27019 tablet_bootstrap.cc:492] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd: Bootstrap starting.
I20260619 06:41:59.538705 27018 log.cc:824] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:59.541493 27020 tablet_bootstrap.cc:654] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac: Neither blocks nor log segments found. Creating new log.
I20260619 06:41:59.541528 27019 tablet_bootstrap.cc:654] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd: Neither blocks nor log segments found. Creating new log.
I20260619 06:41:59.542742 27020 log.cc:824] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:59.542775 27019 log.cc:824] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd: Log is configured to *not* fsync() on all Append() calls
I20260619 06:41:59.543172 27018 tablet_bootstrap.cc:492] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6: No bootstrap required, opened a new log
I20260619 06:41:59.543511 27018 ts_tablet_manager.cc:1397] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260619 06:41:59.546097 27019 tablet_bootstrap.cc:492] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd: No bootstrap required, opened a new log
I20260619 06:41:59.546120 27020 tablet_bootstrap.cc:492] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac: No bootstrap required, opened a new log
I20260619 06:41:59.546384 27019 ts_tablet_manager.cc:1397] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260619 06:41:59.546386 27020 ts_tablet_manager.cc:1397] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260619 06:41:59.551976 27018 raft_consensus.cc:348] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } } peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } }
I20260619 06:41:59.552376 27018 raft_consensus.cc:374] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:41:59.552484 27018 raft_consensus.cc:729] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74f0abc397fe40bd905878ebee32b2f6, State: Initialized, Role: FOLLOWER
I20260619 06:41:59.553158 27018 consensus_queue.cc:260] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } } peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } }
I20260619 06:41:59.555106 27018 ts_tablet_manager.cc:1428] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6: Time spent starting tablet: real 0.011s user 0.006s sys 0.005s
I20260619 06:41:59.557554 27019 raft_consensus.cc:348] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } } peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } }
I20260619 06:41:59.557554 27020 raft_consensus.cc:348] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } } peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } }
I20260619 06:41:59.558061 27020 raft_consensus.cc:374] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:41:59.558061 27019 raft_consensus.cc:374] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:41:59.558180 27019 raft_consensus.cc:729] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4caf8fdb029435982a4656f51e6c3dd, State: Initialized, Role: FOLLOWER
I20260619 06:41:59.558185 27020 raft_consensus.cc:729] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76c633bb0e70489390ae5d27460d29ac, State: Initialized, Role: FOLLOWER
I20260619 06:41:59.558836 27020 consensus_queue.cc:260] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } } peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } }
I20260619 06:41:59.558872 27019 consensus_queue.cc:260] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } } peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } }
I20260619 06:41:59.560104 27000 heartbeater.cc:503] Master 127.10.192.126:35779 was elected leader, sending a full tablet report...
I20260619 06:41:59.561228 27019 ts_tablet_manager.cc:1428] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
I20260619 06:41:59.561975 26866 heartbeater.cc:503] Master 127.10.192.126:35779 was elected leader, sending a full tablet report...
I20260619 06:41:59.562809 27020 ts_tablet_manager.cc:1428] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac: Time spent starting tablet: real 0.016s user 0.014s sys 0.003s
I20260619 06:41:59.573431 27024 raft_consensus.cc:482] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:41:59.573715 27024 raft_consensus.cc:504] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } } peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } }
I20260619 06:41:59.575403 27024 leader_election.cc:288] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4caf8fdb029435982a4656f51e6c3dd (127.10.192.67:38099), 76c633bb0e70489390ae5d27460d29ac (127.10.192.66:40079)
I20260619 06:41:59.582528 27017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.576037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:41495 (local address 127.10.192.66:40079)
0619 06:41:59.576269 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:59.576278 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:59.577084 (+ 806us) server_negotiation.cc:407] Connection header received
0619 06:41:59.577240 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:59.577243 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:59.577333 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:59.577426 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:59.578053 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.578734 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.580716 (+ 1982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.581519 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.581674 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:59.581768 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:59.582101 (+ 333us) server_negotiation.cc:299] Negotiation successful
0619 06:41:59.582248 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 06:41:59.582527 27015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.575919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:53757 (local address 127.10.192.67:38099)
0619 06:41:59.576162 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:59.576171 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:59.576953 (+ 782us) server_negotiation.cc:407] Connection header received
0619 06:41:59.577117 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:59.577141 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:59.577229 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:59.577304 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:41:59.577954 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.578742 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.580765 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.581539 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.581737 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:59.581809 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:59.582102 (+ 293us) server_negotiation.cc:299] Negotiation successful
0619 06:41:59.582254 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260619 06:41:59.582723 27027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.575947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:40079 (local address 127.10.192.65:41495)
0619 06:41:59.576951 (+ 1004us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:59.576975 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:59.577114 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:59.577463 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:59.577468 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:59.577507 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:59.577891 (+ 384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:59.577906 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.578874 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.578882 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:59.580549 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:59.580565 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.581756 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.581763 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:59.581926 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:59.581953 (+ 27us) client_negotiation.cc:769] Sending connection context
0619 06:41:59.582062 (+ 109us) client_negotiation.cc:240] Negotiation successful
0619 06:41:59.582258 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":882,"mutex_wait_us":51,"thread_start_us":411,"threads_started":1}
I20260619 06:41:59.582814 27028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.575802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:38099 (local address 127.10.192.65:53757)
0619 06:41:59.576844 (+ 1042us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:59.576860 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:41:59.576978 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:41:59.577346 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:41:59.577351 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:41:59.577380 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:41:59.577803 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:59.577813 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.578901 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.578905 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:59.580582 (+ 1677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:41:59.580593 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.581814 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.581819 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:41:59.581936 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:59.581958 (+ 22us) client_negotiation.cc:769] Sending connection context
0619 06:41:59.582061 (+ 103us) client_negotiation.cc:240] Negotiation successful
0619 06:41:59.582235 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":916,"mutex_wait_us":67,"thread_start_us":774,"threads_started":1}
I20260619 06:41:59.583895 26955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bff8dc7b374b446c87e8cebab4b2e54c" candidate_uuid: "74f0abc397fe40bd905878ebee32b2f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4caf8fdb029435982a4656f51e6c3dd" is_pre_election: true
I20260619 06:41:59.583950 26821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bff8dc7b374b446c87e8cebab4b2e54c" candidate_uuid: "74f0abc397fe40bd905878ebee32b2f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76c633bb0e70489390ae5d27460d29ac" is_pre_election: true
I20260619 06:41:59.584406 26821 raft_consensus.cc:2454] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f0abc397fe40bd905878ebee32b2f6 in term 0.
I20260619 06:41:59.584409 26955 raft_consensus.cc:2454] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74f0abc397fe40bd905878ebee32b2f6 in term 0.
I20260619 06:41:59.585132 26623 leader_election.cc:302] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 74f0abc397fe40bd905878ebee32b2f6, 76c633bb0e70489390ae5d27460d29ac, c4caf8fdb029435982a4656f51e6c3dd; no voters:
I20260619 06:41:59.585549 27024 raft_consensus.cc:2781] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:41:59.585700 27024 raft_consensus.cc:482] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:41:59.585837 27024 raft_consensus.cc:3037] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:41:59.588189 27024 raft_consensus.cc:504] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } } peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } }
I20260619 06:41:59.588861 27024 leader_election.cc:288] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [CANDIDATE]: Term 1 election: Requested vote from peers c4caf8fdb029435982a4656f51e6c3dd (127.10.192.67:38099), 76c633bb0e70489390ae5d27460d29ac (127.10.192.66:40079)
I20260619 06:41:59.589341 26955 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bff8dc7b374b446c87e8cebab4b2e54c" candidate_uuid: "74f0abc397fe40bd905878ebee32b2f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4caf8fdb029435982a4656f51e6c3dd"
I20260619 06:41:59.589362 26821 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bff8dc7b374b446c87e8cebab4b2e54c" candidate_uuid: "74f0abc397fe40bd905878ebee32b2f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76c633bb0e70489390ae5d27460d29ac"
I20260619 06:41:59.589552 26955 raft_consensus.cc:3037] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:41:59.589564 26821 raft_consensus.cc:3037] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:41:59.592099 26955 raft_consensus.cc:2454] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f0abc397fe40bd905878ebee32b2f6 in term 1.
I20260619 06:41:59.592149 26821 raft_consensus.cc:2454] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74f0abc397fe40bd905878ebee32b2f6 in term 1.
I20260619 06:41:59.592650 26623 leader_election.cc:302] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 74f0abc397fe40bd905878ebee32b2f6, c4caf8fdb029435982a4656f51e6c3dd; no voters:
I20260619 06:41:59.592943 27024 raft_consensus.cc:2781] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:41:59.593375 27024 raft_consensus.cc:686] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [term 1 LEADER]: Becoming Leader. State: Replica: 74f0abc397fe40bd905878ebee32b2f6, State: Running, Role: LEADER
I20260619 06:41:59.593873 27024 consensus_queue.cc:237] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } } peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } }
I20260619 06:41:59.598685 26544 catalog_manager.cc:5495] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74f0abc397fe40bd905878ebee32b2f6 (127.10.192.65). New cstate: current_term: 1 leader_uuid: "74f0abc397fe40bd905878ebee32b2f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } health_report { overall_health: UNKNOWN } } }
W20260619 06:41:59.626991 26733 tablet.cc:2369] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:41:59.629035 27013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.623346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45460 (local address 127.10.192.65:32887)
0619 06:41:59.623562 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:59.623568 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:59.623588 (+ 20us) server_negotiation.cc:407] Connection header received
0619 06:41:59.623737 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:59.623741 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:59.623820 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:59.623982 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:41:59.624351 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.625064 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.626594 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.627264 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.627397 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:59.627926 (+ 529us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:41:59.628493 (+ 567us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:41:59.628615 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:59.628686 (+ 71us) server_negotiation.cc:299] Negotiation successful
0619 06:41:59.628754 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 06:41:59.637382 26955 raft_consensus.cc:1261] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd [term 1 FOLLOWER]: Refusing update from remote peer 74f0abc397fe40bd905878ebee32b2f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:41:59.637421 26821 raft_consensus.cc:1261] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac [term 1 FOLLOWER]: Refusing update from remote peer 74f0abc397fe40bd905878ebee32b2f6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:41:59.638439 27029 consensus_queue.cc:1035] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:41:59.638788 27024 consensus_queue.cc:1035] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:41:59.651302 27034 mvcc.cc:205] Tried to move back new op lower bound from 7298463005224275968 to 7298463005060235264. Current Snapshot: MvccSnapshot[applied={T|T < 7298463005224275968}]
I20260619 06:41:59.653966 27032 mvcc.cc:205] Tried to move back new op lower bound from 7298463005224275968 to 7298463005060235264. Current Snapshot: MvccSnapshot[applied={T|T < 7298463005224275968 or (T in {7298463005224275968})}]
I20260619 06:41:59.666471 26544 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45246:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:41:59.666761 26544 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45246:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:41:59.670967 26544 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef: Sending DeleteTablet for 3 replicas of tablet bff8dc7b374b446c87e8cebab4b2e54c
I20260619 06:41:59.672271 26667 tablet_service.cc:1514] Processing DeleteTablet for tablet bff8dc7b374b446c87e8cebab4b2e54c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:41:59 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:45458
I20260619 06:41:59.672242 26935 tablet_service.cc:1514] Processing DeleteTablet for tablet bff8dc7b374b446c87e8cebab4b2e54c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:41:59 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:55056
I20260619 06:41:59.672518 26801 tablet_service.cc:1514] Processing DeleteTablet for tablet bff8dc7b374b446c87e8cebab4b2e54c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:41:59 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:59180
I20260619 06:41:59.673772 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 26604
I20260619 06:41:59.682140 27043 tablet_replica.cc:330] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac: stopping tablet replica
I20260619 06:41:59.683733 27043 raft_consensus.cc:2229] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:41:59.685390 27043 raft_consensus.cc:2258] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:41:59.689410 27043 ts_tablet_manager.cc:1905] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:41:59.694482 27041 tablet_replica.cc:330] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd: stopping tablet replica
I20260619 06:41:59.695104 27042 tablet_replica.cc:330] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6: stopping tablet replica
I20260619 06:41:59.695604 27042 raft_consensus.cc:2229] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:41:59.696115 27041 raft_consensus.cc:2229] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:41:59.696503 27042 raft_consensus.cc:2258] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:41:59.696723 27041 raft_consensus.cc:2258] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:41:59.698897 27042 ts_tablet_manager.cc:1905] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:41:59.700363 27041 ts_tablet_manager.cc:1905] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:41:59.700752 27043 ts_tablet_manager.cc:1918] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:41:59.700973 27043 log.cc:1196] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/bff8dc7b374b446c87e8cebab4b2e54c
I20260619 06:41:59.701579 27043 ts_tablet_manager.cc:1939] T bff8dc7b374b446c87e8cebab4b2e54c P 76c633bb0e70489390ae5d27460d29ac: Deleting consensus metadata
Jun 19 06:41:59 dist-test-slave-7lz4 krb5kdc[26499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:41:59.703778 26530 catalog_manager.cc:4841] TS 76c633bb0e70489390ae5d27460d29ac (127.10.192.66:40079): tablet bff8dc7b374b446c87e8cebab4b2e54c (table test-table [id=814bc602c3664fa189a7a16bd9c4022b]) successfully deleted
I20260619 06:41:59.710708 27013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.676127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45476 (local address 127.10.192.65:32887)
0619 06:41:59.681927 (+ 5800us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:59.681934 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:59.687785 (+ 5851us) server_negotiation.cc:407] Connection header received
0619 06:41:59.688334 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:59.688340 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:59.688441 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:59.688518 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:59.690714 (+ 2196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.692048 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.697118 (+ 5070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.697908 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.698018 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:59.704130 (+ 6112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:59.704151 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:59.704173 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:59.704234 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:59.707617 (+ 3383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:59.708436 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:59.708450 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:59.708452 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:59.708619 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:59.709045 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:59.709051 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:59.709054 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:59.709424 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:59.709747 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:59.710099 (+ 352us) server_negotiation.cc:299] Negotiation successful
0619 06:41:59.710345 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5648}
I20260619 06:41:59.711457 26727 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:59.713649 27041 ts_tablet_manager.cc:1918] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:41:59.713851 27041 log.cc:1196] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/bff8dc7b374b446c87e8cebab4b2e54c
I20260619 06:41:59.714547 27041 ts_tablet_manager.cc:1939] T bff8dc7b374b446c87e8cebab4b2e54c P c4caf8fdb029435982a4656f51e6c3dd: Deleting consensus metadata
I20260619 06:41:59.716763 26531 catalog_manager.cc:4841] TS c4caf8fdb029435982a4656f51e6c3dd (127.10.192.67:38099): tablet bff8dc7b374b446c87e8cebab4b2e54c (table test-table [id=814bc602c3664fa189a7a16bd9c4022b]) successfully deleted
I20260619 06:41:59.814369 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 26604
W20260619 06:41:59.832604 26530 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.192.65:32887 (error 108)
I20260619 06:41:59.832892 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 26738
I20260619 06:41:59.834614 27016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.834192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:32887 (local address 127.0.0.1:45480)
0619 06:41:59.834360 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:59.834467 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:32887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260619 06:41:59.834863 26530 catalog_manager.cc:4584] TS 74f0abc397fe40bd905878ebee32b2f6 (127.10.192.65:32887): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bff8dc7b374b446c87e8cebab4b2e54c: Network error: Client connection negotiation failed: client connection to 127.10.192.65:32887: connect: Connection refused (error 111)
Jun 19 06:41:59 dist-test-slave-7lz4 krb5kdc[26499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.66@KRBTEST.COM
I20260619 06:41:59.849113 27017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.833817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59194 (local address 127.10.192.66:40079)
0619 06:41:59.833993 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:59.833998 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:59.834078 (+ 80us) server_negotiation.cc:407] Connection header received
0619 06:41:59.834288 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:59.834293 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:59.834369 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:59.834493 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:59.836151 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.836916 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.838336 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.838778 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.838925 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:59.843555 (+ 4630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:59.843569 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:59.843586 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:59.843677 (+ 91us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:59.846405 (+ 2728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:59.847230 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:59.847237 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:59.847239 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:59.847366 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:59.847763 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:59.847767 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:59.847769 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:59.848151 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:59.848389 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:59.848600 (+ 211us) server_negotiation.cc:299] Negotiation successful
0619 06:41:59.848773 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 06:41:59.849867 26861 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:41:59.885768 27016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.885255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:32887 (local address 127.0.0.1:45484)
0619 06:41:59.885493 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:59.885590 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:32887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103}
I20260619 06:41:59.886914 27016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.886548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:32887 (local address 127.0.0.1:45492)
0619 06:41:59.886721 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:59.886800 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:32887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260619 06:41:59.939615 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 26738
I20260619 06:41:59.956616 27016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.955946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:32887 (local address 127.0.0.1:45498)
0619 06:41:59.956235 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:59.956367 (+ 132us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:32887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260619 06:41:59.957494 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 26872
I20260619 06:41:59.958070 27016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.957571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:32887 (local address 127.0.0.1:45510)
0619 06:41:59.957801 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0619 06:41:59.957880 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:32887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
Jun 19 06:41:59 dist-test-slave-7lz4 krb5kdc[26499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851317, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.67@KRBTEST.COM
I20260619 06:41:59.973403 27015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:41:59.958400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55070 (local address 127.10.192.67:38099)
0619 06:41:59.958591 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0619 06:41:59.958597 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:41:59.958618 (+ 21us) server_negotiation.cc:407] Connection header received
0619 06:41:59.958850 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:41:59.958855 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:41:59.958919 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:41:59.959021 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:41:59.960605 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.961492 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.962839 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:41:59.963260 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:41:59.963401 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:41:59.968003 (+ 4602us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:41:59.968020 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:41:59.968035 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:41:59.968072 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:41:59.970874 (+ 2802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:59.971572 (+ 698us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:59.971580 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:59.971582 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:59.971773 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:41:59.972114 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:41:59.972117 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:41:59.972119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:41:59.972441 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:41:59.972667 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0619 06:41:59.972903 (+ 236us) server_negotiation.cc:299] Negotiation successful
0619 06:41:59.973067 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 06:41:59.974059 26995 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:42:00.051141 27016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:00.050598 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:32887 (local address 127.0.0.1:45526)
0619 06:42:00.050813 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:00.050967 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:32887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260619 06:42:00.052371 27016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:00.051963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:32887 (local address 127.0.0.1:45534)
0619 06:42:00.052171 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:00.052255 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:32887: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260619 06:42:00.066195 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 26872
I20260619 06:42:00.082799 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 26512
I20260619 06:42:00.084090 26574 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:42:00.195748 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 26512
I20260619 06:42:20.218148 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:35779
--webserver_interface=127.10.192.126
--webserver_port=35325
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:41323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:35779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:42:20.564759 27050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:42:20.565092 27050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:42:20.565255 27050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:42:20.572835 27050 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260619 06:42:20.572968 27050 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260619 06:42:20.573007 27050 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260619 06:42:20.573107 27050 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:42:20.573210 27050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:42:20.573326 27050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:42:20.573413 27050 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:42:20.573508 27050 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:42:20.583953 27050 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:41323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:35779
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:35779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=35325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:42:20.585386 27050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:42:20.586846 27050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:42:20.611277 27056 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:42:20.611354 27057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:42:20.611330 27059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:42:20.612273 27050 server_base.cc:1034] running on GCE node
I20260619 06:42:20.613274 27050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:42:20.615088 27050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:42:20.616389 27050 hybrid_clock.cc:648] HybridClock initialized: now 1781851340616299 us; error 59 us; skew 500 ppm
I20260619 06:42:20.616837 27050 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:42:20 dist-test-slave-7lz4 krb5kdc[26499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851340, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:42:20.627058 27050 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:42:20.629081 27050 webserver.cc:460] Webserver started at http://127.10.192.126:35325/ using document root <none> and password file <none>
I20260619 06:42:20.629990 27050 fs_manager.cc:359] Metadata directory not provided
I20260619 06:42:20.630170 27050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:42:20.636803 27050 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260619 06:42:20.640237 27066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:42:20.641881 27050 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260619 06:42:20.642112 27050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "1628f24adb7b4063b4b59fbfcec676ef"
format_stamp: "Formatted at 2026-06-19 06:41:57 on dist-test-slave-7lz4"
server_key: "d175e49792b2938c59b87d2410299694"
server_key_iv: "34e59f47fb1903e8743a522cab651a49"
server_key_version: "encryptionkey@0"
I20260619 06:42:20.643268 27050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:42:20.666325 27050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:42:20.671329 27050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:42:20.671697 27050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:42:20.693445 27050 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:35779
I20260619 06:42:20.693483 27117 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:35779 every 8 connection(s)
I20260619 06:42:20.695287 27050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:42:20.703976 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 27050
I20260619 06:42:20.704756 27118 sys_catalog.cc:263] Verifying existing consensus state
I20260619 06:42:20.705145 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:32887
--local_ip_for_outbound_sockets=127.10.192.65
--tserver_master_addrs=127.10.192.126:35779
--webserver_port=33537
--webserver_interface=127.10.192.65
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:41323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:42:20.710958 27118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef: Bootstrap starting.
I20260619 06:42:20.733628 27118 log.cc:824] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef: Log is configured to *not* fsync() on all Append() calls
I20260619 06:42:20.746740 27118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 06:42:20.747416 27118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef: Bootstrap complete.
I20260619 06:42:20.757375 27118 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1628f24adb7b4063b4b59fbfcec676ef" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35779 } }
I20260619 06:42:20.758388 27118 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1628f24adb7b4063b4b59fbfcec676ef, State: Initialized, Role: FOLLOWER
I20260619 06:42:20.759101 27118 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1628f24adb7b4063b4b59fbfcec676ef" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35779 } }
I20260619 06:42:20.759385 27118 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:42:20.759532 27118 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:42:20.759753 27118 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 1 FOLLOWER]: Advancing to term 2
I20260619 06:42:20.764159 27118 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1628f24adb7b4063b4b59fbfcec676ef" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35779 } }
I20260619 06:42:20.764806 27118 leader_election.cc:302] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1628f24adb7b4063b4b59fbfcec676ef; no voters:
I20260619 06:42:20.765558 27118 leader_election.cc:288] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [CANDIDATE]: Term 2 election: Requested vote from peers
I20260619 06:42:20.765738 27122 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 2 FOLLOWER]: Leader election won for term 2
I20260619 06:42:20.766871 27122 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 2 LEADER]: Becoming Leader. State: Replica: 1628f24adb7b4063b4b59fbfcec676ef, State: Running, Role: LEADER
I20260619 06:42:20.767525 27122 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1628f24adb7b4063b4b59fbfcec676ef" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35779 } }
I20260619 06:42:20.768054 27118 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:42:20.770298 27124 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1628f24adb7b4063b4b59fbfcec676ef. Latest consensus state: current_term: 2 leader_uuid: "1628f24adb7b4063b4b59fbfcec676ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1628f24adb7b4063b4b59fbfcec676ef" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35779 } } }
I20260619 06:42:20.770716 27124 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [sys.catalog]: This master's current role is: LEADER
I20260619 06:42:20.771245 27123 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1628f24adb7b4063b4b59fbfcec676ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1628f24adb7b4063b4b59fbfcec676ef" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35779 } } }
I20260619 06:42:20.771777 27123 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [sys.catalog]: This master's current role is: LEADER
I20260619 06:42:20.780642 27130 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:42:20.792155 27130 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:42:20.793856 27130 catalog_manager.cc:1259] Loaded cluster ID: 110fcb7b919e4f33a137a3e7e0087b1d
I20260619 06:42:20.794062 27130 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:42:20.798467 27130 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:42:20.800354 27130 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef: Loaded TSK: 0
I20260619 06:42:20.833585 27130 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef: Generated new TSK 1
I20260619 06:42:20.834031 27130 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260619 06:42:21.089758 27120 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:42:21.090085 27120 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:42:21.090246 27120 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:42:21.098102 27120 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:42:21.098229 27120 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:42:21.098405 27120 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:42:21.109287 27120 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:41323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:32887
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=33537
--tserver_master_addrs=127.10.192.126:35779
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:42:21.110793 27120 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:42:21.112326 27120 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:42:21.128975 27146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:42:21.129204 27145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:42:21.129825 27148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:42:21.131072 27120 server_base.cc:1034] running on GCE node
I20260619 06:42:21.131889 27120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:42:21.133194 27120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:42:21.134457 27120 hybrid_clock.cc:648] HybridClock initialized: now 1781851341134395 us; error 43 us; skew 500 ppm
I20260619 06:42:21.134879 27120 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:42:21 dist-test-slave-7lz4 krb5kdc[26499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851341, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:42:21.138967 27120 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:42:21.140789 27120 webserver.cc:460] Webserver started at http://127.10.192.65:33537/ using document root <none> and password file <none>
I20260619 06:42:21.141607 27120 fs_manager.cc:359] Metadata directory not provided
I20260619 06:42:21.141767 27120 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:42:21.148348 27120 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260619 06:42:21.151988 27155 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:42:21.153640 27120 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:42:21.153849 27120 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "74f0abc397fe40bd905878ebee32b2f6"
format_stamp: "Formatted at 2026-06-19 06:41:58 on dist-test-slave-7lz4"
server_key: "5184d01f360eec82fa86089ed9ec32f5"
server_key_iv: "dfe1417daaf034ec9f6bf74452355a9c"
server_key_version: "encryptionkey@0"
I20260619 06:42:21.154889 27120 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:42:21.168821 27120 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:42:21.173841 27120 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:42:21.174173 27120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:42:21.175261 27120 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:42:21.177310 27162 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260619 06:42:21.183058 27162 ts_tablet_manager.cc:1852] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260619 06:42:21.184247 27162 ts_tablet_manager.cc:1905] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:42:21.192301 27162 ts_tablet_manager.cc:1918] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:42:21.192555 27162 log.cc:1196] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/bff8dc7b374b446c87e8cebab4b2e54c
I20260619 06:42:21.193063 27162 ts_tablet_manager.cc:1939] T bff8dc7b374b446c87e8cebab4b2e54c P 74f0abc397fe40bd905878ebee32b2f6: Deleting consensus metadata
I20260619 06:42:21.193514 27120 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260619 06:42:21.193674 27120 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.017s user 0.001s sys 0.000s
I20260619 06:42:21.193836 27120 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:42:21.193941 27120 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:42:21.230234 27120 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:32887
I20260619 06:42:21.230291 27268 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:32887 every 8 connection(s)
I20260619 06:42:21.231715 27120 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:42:21.239903 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 27120
I20260619 06:42:21.240696 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:40079
--local_ip_for_outbound_sockets=127.10.192.66
--tserver_master_addrs=127.10.192.126:35779
--webserver_port=33379
--webserver_interface=127.10.192.66
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:41323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 06:42:21 dist-test-slave-7lz4 krb5kdc[26499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851341, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:42:21.260510 27272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:21.234794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:48531)
0619 06:42:21.235666 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:21.235720 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 06:42:21.237585 (+ 1865us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:42:21.239115 (+ 1530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:42:21.239124 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:42:21.240029 (+ 905us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:42:21.240911 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:42:21.240946 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:42:21.242705 (+ 1759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:42:21.242713 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:42:21.244977 (+ 2264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:42:21.244998 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:42:21.246114 (+ 1116us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:42:21.246123 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:42:21.246455 (+ 332us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:21.247267 (+ 812us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:42:21.247303 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:42:21.250502 (+ 3199us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:42:21.255747 (+ 5245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:42:21.255756 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:42:21.255770 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:42:21.256264 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:42:21.256839 (+ 575us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:42:21.256842 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:42:21.256845 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:42:21.257018 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:42:21.258068 (+ 1050us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:42:21.258074 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:42:21.258470 (+ 396us) client_negotiation.cc:769] Sending connection context
0619 06:42:21.258735 (+ 265us) client_negotiation.cc:240] Negotiation successful
0619 06:42:21.259275 (+ 540us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":534,"thread_start_us":344,"threads_started":1}
I20260619 06:42:21.260883 27271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:21.234688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:48531 (local address 127.10.192.126:35779)
0619 06:42:21.235409 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0619 06:42:21.235425 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 06:42:21.235880 (+ 455us) server_negotiation.cc:407] Connection header received
0619 06:42:21.238223 (+ 2343us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:42:21.238237 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:42:21.238612 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:42:21.238949 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:42:21.241211 (+ 2262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:21.242499 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:21.245165 (+ 2666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:21.245852 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:21.246012 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:21.250905 (+ 4893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:42:21.250920 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:42:21.250945 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:42:21.251010 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:42:21.255480 (+ 4470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:42:21.256447 (+ 967us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:42:21.256460 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:42:21.256472 (+ 12us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:42:21.256712 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:42:21.257155 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:42:21.257163 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:42:21.257170 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:42:21.257937 (+ 767us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:42:21.258147 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0619 06:42:21.259048 (+ 901us) server_negotiation.cc:299] Negotiation successful
0619 06:42:21.259528 (+ 480us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":378,"threads_started":1}
I20260619 06:42:21.263924 27269 heartbeater.cc:347] Connected to a master server at 127.10.192.126:35779
I20260619 06:42:21.264307 27269 heartbeater.cc:464] Registering TS with master...
I20260619 06:42:21.265277 27269 heartbeater.cc:511] Master 127.10.192.126:35779 requested a full tablet report, sending...
I20260619 06:42:21.267961 27083 ts_manager.cc:194] Registered new tserver with Master: 74f0abc397fe40bd905878ebee32b2f6 (127.10.192.65:32887)
I20260619 06:42:21.269958 27083 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:48531
W20260619 06:42:21.599041 27273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:42:21.599483 27273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:42:21.599725 27273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:42:21.607535 27273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:42:21.607771 27273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:42:21.607980 27273 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:42:21.618920 27273 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:41323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:40079
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=33379
--tserver_master_addrs=127.10.192.126:35779
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:42:21.620455 27273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:42:21.621979 27273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:42:21.636447 27278 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:42:21.636507 27281 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:42:21.636447 27279 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:42:21.637355 27273 server_base.cc:1034] running on GCE node
I20260619 06:42:21.638078 27273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:42:21.639134 27273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:42:21.640354 27273 hybrid_clock.cc:648] HybridClock initialized: now 1781851341640279 us; error 58 us; skew 500 ppm
I20260619 06:42:21.640735 27273 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:42:21 dist-test-slave-7lz4 krb5kdc[26499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851341, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:42:21.644064 27273 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:42:21.645612 27273 webserver.cc:460] Webserver started at http://127.10.192.66:33379/ using document root <none> and password file <none>
I20260619 06:42:21.646358 27273 fs_manager.cc:359] Metadata directory not provided
I20260619 06:42:21.646545 27273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:42:21.652665 27273 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260619 06:42:21.655565 27288 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:42:21.657037 27273 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 06:42:21.657223 27273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "76c633bb0e70489390ae5d27460d29ac"
format_stamp: "Formatted at 2026-06-19 06:41:58 on dist-test-slave-7lz4"
server_key: "6ff8527fc1175b50de07aec4701a962a"
server_key_iv: "1b3191ef1e9390840b84367a7e4ec3af"
server_key_version: "encryptionkey@0"
I20260619 06:42:21.658246 27273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:42:21.678390 27273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:42:21.682857 27273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:42:21.683182 27273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:42:21.684415 27273 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:42:21.685868 27273 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:42:21.685995 27273 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:42:21.686146 27273 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:42:21.686242 27273 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:42:21.728729 27273 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:40079
I20260619 06:42:21.728783 27400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:40079 every 8 connection(s)
I20260619 06:42:21.730377 27273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:42:21.740509 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 27273
I20260619 06:42:21.741247 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:38099
--local_ip_for_outbound_sockets=127.10.192.67
--tserver_master_addrs=127.10.192.126:35779
--webserver_port=45191
--webserver_interface=127.10.192.67
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:41323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Jun 19 06:42:21 dist-test-slave-7lz4 krb5kdc[26499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851341, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:42:21.752607 27271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:21.733216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:53475 (local address 127.10.192.126:35779)
0619 06:42:21.733419 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0619 06:42:21.733424 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:42:21.734767 (+ 1343us) server_negotiation.cc:407] Connection header received
0619 06:42:21.736776 (+ 2009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:42:21.736782 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:42:21.736912 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:42:21.737031 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:42:21.738667 (+ 1636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:21.739434 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:21.741218 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:21.741778 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:21.741930 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:21.745793 (+ 3863us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:42:21.745799 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:42:21.745802 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:42:21.745840 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:42:21.749016 (+ 3176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:42:21.749900 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:42:21.749910 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:42:21.749913 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:42:21.750046 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:42:21.750631 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:42:21.750638 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:42:21.750643 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:42:21.750998 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:42:21.751169 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0619 06:42:21.751978 (+ 809us) server_negotiation.cc:299] Negotiation successful
0619 06:42:21.752239 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260619 06:42:21.753813 27403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:21.733818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:53475)
0619 06:42:21.734584 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:21.734629 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 06:42:21.736489 (+ 1860us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:42:21.737284 (+ 795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:42:21.737293 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:42:21.737856 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:42:21.738471 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:42:21.738489 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:42:21.739617 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:42:21.739620 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:42:21.741060 (+ 1440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:42:21.741073 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:42:21.742057 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:42:21.742065 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:42:21.742325 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:21.743054 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:42:21.743083 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:42:21.745475 (+ 2392us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:42:21.749220 (+ 3745us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:42:21.749229 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:42:21.749245 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:42:21.749744 (+ 499us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:42:21.750171 (+ 427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:42:21.750176 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:42:21.750180 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:42:21.750410 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:42:21.751140 (+ 730us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:42:21.751148 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:42:21.751542 (+ 394us) client_negotiation.cc:769] Sending connection context
0619 06:42:21.751887 (+ 345us) client_negotiation.cc:240] Negotiation successful
0619 06:42:21.752491 (+ 604us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":279,"threads_started":1}
I20260619 06:42:21.755506 27401 heartbeater.cc:347] Connected to a master server at 127.10.192.126:35779
I20260619 06:42:21.755959 27401 heartbeater.cc:464] Registering TS with master...
I20260619 06:42:21.757056 27401 heartbeater.cc:511] Master 127.10.192.126:35779 requested a full tablet report, sending...
I20260619 06:42:21.759222 27083 ts_manager.cc:194] Registered new tserver with Master: 76c633bb0e70489390ae5d27460d29ac (127.10.192.66:40079)
I20260619 06:42:21.760303 27083 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:53475
W20260619 06:42:22.093184 27404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:42:22.093559 27404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:42:22.093730 27404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:42:22.101284 27404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:42:22.101459 27404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:42:22.101650 27404 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:42:22.111827 27404 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:41323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:38099
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=45191
--tserver_master_addrs=127.10.192.126:35779
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:42:22.113301 27404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:42:22.114672 27404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:42:22.128827 27410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:42:22.128880 27409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:42:22.128851 27412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:42:22.129837 27404 server_base.cc:1034] running on GCE node
I20260619 06:42:22.130501 27404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:42:22.131534 27404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:42:22.132810 27404 hybrid_clock.cc:648] HybridClock initialized: now 1781851342132756 us; error 48 us; skew 500 ppm
I20260619 06:42:22.133173 27404 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:42:22 dist-test-slave-7lz4 krb5kdc[26499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851342, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:42:22.136468 27404 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:42:22.137979 27404 webserver.cc:460] Webserver started at http://127.10.192.67:45191/ using document root <none> and password file <none>
I20260619 06:42:22.138649 27404 fs_manager.cc:359] Metadata directory not provided
I20260619 06:42:22.138761 27404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:42:22.145015 27404 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s
I20260619 06:42:22.148101 27419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:42:22.149606 27404 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260619 06:42:22.149819 27404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "c4caf8fdb029435982a4656f51e6c3dd"
format_stamp: "Formatted at 2026-06-19 06:41:59 on dist-test-slave-7lz4"
server_key: "ba19e8c0fd2c597f501ccc21b97f819e"
server_key_iv: "b036f261cb3aff0c69dcec151c72fd03"
server_key_version: "encryptionkey@0"
I20260619 06:42:22.150859 27404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:42:22.175503 27404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:42:22.180212 27404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:42:22.180454 27404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:42:22.181409 27404 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:42:22.182724 27404 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:42:22.182816 27404 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:42:22.182992 27404 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:42:22.183058 27404 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:42:22.216980 27404 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:38099
I20260619 06:42:22.217064 27531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:38099 every 8 connection(s)
I20260619 06:42:22.218775 27404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:42:22.229069 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 27404
Jun 19 06:42:22 dist-test-slave-7lz4 krb5kdc[26499](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851342, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:42:22.243547 27271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:22.221903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:58153 (local address 127.10.192.126:35779)
0619 06:42:22.222123 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0619 06:42:22.222130 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:42:22.223444 (+ 1314us) server_negotiation.cc:407] Connection header received
0619 06:42:22.225414 (+ 1970us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:42:22.225419 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:42:22.225498 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:42:22.225597 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:42:22.227332 (+ 1735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.228207 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.230318 (+ 2111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.231254 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.231396 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:22.236411 (+ 5015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:42:22.236418 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:42:22.236421 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:42:22.236454 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:42:22.240008 (+ 3554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:42:22.241026 (+ 1018us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:42:22.241030 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:42:22.241033 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:42:22.241154 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:42:22.241651 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:42:22.241654 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:42:22.241656 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:42:22.241913 (+ 257us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:42:22.242073 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0619 06:42:22.243040 (+ 967us) server_negotiation.cc:299] Negotiation successful
0619 06:42:22.243205 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260619 06:42:22.244894 27534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:22.222430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:58153)
0619 06:42:22.223259 (+ 829us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:22.223298 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 06:42:22.225128 (+ 1830us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:42:22.225871 (+ 743us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:42:22.225880 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:42:22.226499 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:42:22.227133 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:42:22.227153 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.228386 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.228390 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:42:22.230123 (+ 1733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:42:22.230141 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.231894 (+ 1753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.231904 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:42:22.232494 (+ 590us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:22.233415 (+ 921us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:42:22.233447 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:42:22.236183 (+ 2736us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:42:22.240191 (+ 4008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:42:22.240203 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:42:22.240223 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:42:22.240900 (+ 677us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:42:22.241274 (+ 374us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:42:22.241279 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:42:22.241283 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:42:22.241527 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:42:22.242067 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:42:22.242077 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:42:22.242556 (+ 479us) client_negotiation.cc:769] Sending connection context
0619 06:42:22.242939 (+ 383us) client_negotiation.cc:240] Negotiation successful
0619 06:42:22.243509 (+ 570us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"thread_start_us":319,"threads_started":1}
I20260619 06:42:22.246634 27532 heartbeater.cc:347] Connected to a master server at 127.10.192.126:35779
I20260619 06:42:22.246999 27532 heartbeater.cc:464] Registering TS with master...
I20260619 06:42:22.248027 27532 heartbeater.cc:511] Master 127.10.192.126:35779 requested a full tablet report, sending...
I20260619 06:42:22.249577 27535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:22.230199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57886 (local address 127.10.192.126:35779)
0619 06:42:22.233958 (+ 3759us) server_negotiation.cc:206] Beginning negotiation
0619 06:42:22.233964 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:42:22.234266 (+ 302us) server_negotiation.cc:407] Connection header received
0619 06:42:22.234472 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:42:22.234478 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:42:22.234565 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:42:22.234692 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:42:22.236732 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.237912 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.239317 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.240085 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.240200 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:22.243489 (+ 3289us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:42:22.243498 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:42:22.243505 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:42:22.243550 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:42:22.246691 (+ 3141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:42:22.247481 (+ 790us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:42:22.247487 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:42:22.247490 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:42:22.247676 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:42:22.248067 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:42:22.248072 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:42:22.248075 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:42:22.248434 (+ 359us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:42:22.248714 (+ 280us) server_negotiation.cc:1035] Waiting for connection context
0619 06:42:22.248976 (+ 262us) server_negotiation.cc:299] Negotiation successful
0619 06:42:22.249148 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3622,"thread_start_us":3457,"threads_started":1}
I20260619 06:42:22.249801 27083 ts_manager.cc:194] Registered new tserver with Master: c4caf8fdb029435982a4656f51e6c3dd (127.10.192.67:38099)
I20260619 06:42:22.250948 27083 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:58153
I20260619 06:42:22.252595 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 06:42:22.259423 27535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:22.253599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57902 (local address 127.10.192.126:35779)
0619 06:42:22.253800 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0619 06:42:22.253806 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:42:22.254237 (+ 431us) server_negotiation.cc:407] Connection header received
0619 06:42:22.254431 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:42:22.254435 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:42:22.254580 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:42:22.254694 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:42:22.255236 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.256139 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.257583 (+ 1444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.258046 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.258169 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:22.258601 (+ 432us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:42:22.258862 (+ 261us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0619 06:42:22.259231 (+ 369us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57902: token expired
Metrics: {"server-negotiator.queue_time_us":63}
W20260619 06:42:22.259569 27535 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57902: token expired
W20260619 06:42:22.260097 27003 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.10.192.126:35779)
I20260619 06:42:22.273882 27535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:22.260569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57914 (local address 127.10.192.126:35779)
0619 06:42:22.260710 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0619 06:42:22.260714 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:42:22.260728 (+ 14us) server_negotiation.cc:407] Connection header received
0619 06:42:22.260851 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:42:22.260855 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:42:22.260913 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:42:22.260990 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:42:22.262460 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.263261 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.264770 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.265246 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.265363 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:22.268279 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:42:22.268284 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:42:22.268287 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:42:22.268325 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:42:22.271282 (+ 2957us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:42:22.272007 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:42:22.272012 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:42:22.272014 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:42:22.272154 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:42:22.272486 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:42:22.272489 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:42:22.272491 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:42:22.272836 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:42:22.273036 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0619 06:42:22.273365 (+ 329us) server_negotiation.cc:299] Negotiation successful
0619 06:42:22.273553 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260619 06:42:22.274026 27269 heartbeater.cc:503] Master 127.10.192.126:35779 was elected leader, sending a full tablet report...
I20260619 06:42:22.277659 27082 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57914:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:42:22.285368 27082 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:42:22.320346 27542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:22.297975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:40079 (local address 127.0.0.1:47900)
0619 06:42:22.298975 (+ 1000us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:22.299045 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0619 06:42:22.299291 (+ 246us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:42:22.312031 (+ 12740us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:42:22.312042 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:42:22.312079 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:42:22.312540 (+ 461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:42:22.312552 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.314708 (+ 2156us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.314714 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:42:22.317509 (+ 2795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:42:22.317524 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.319173 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.319180 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:42:22.319387 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:22.319445 (+ 58us) client_negotiation.cc:769] Sending connection context
0619 06:42:22.319618 (+ 173us) client_negotiation.cc:240] Negotiation successful
0619 06:42:22.319864 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":634,"mutex_wait_us":70,"thread_start_us":401,"threads_started":1}
I20260619 06:42:22.320844 27545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:22.299242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:32887 (local address 127.0.0.1:34484)
0619 06:42:22.309941 (+ 10699us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:22.309974 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0619 06:42:22.310170 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:42:22.312972 (+ 2802us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:42:22.312977 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:42:22.313002 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:42:22.313350 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:42:22.313363 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.315385 (+ 2022us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.315390 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:42:22.317415 (+ 2025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:42:22.317435 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.319692 (+ 2257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.319698 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:42:22.319868 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:22.319896 (+ 28us) client_negotiation.cc:769] Sending connection context
0619 06:42:22.319986 (+ 90us) client_negotiation.cc:240] Negotiation successful
0619 06:42:22.320131 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10455,"mutex_wait_us":75,"thread_start_us":12506,"threads_started":1}
I20260619 06:42:22.321368 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:22.298160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47900 (local address 127.10.192.66:40079)
0619 06:42:22.311143 (+ 12983us) server_negotiation.cc:206] Beginning negotiation
0619 06:42:22.311156 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 06:42:22.311197 (+ 41us) server_negotiation.cc:407] Connection header received
0619 06:42:22.311331 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:42:22.311340 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:42:22.311705 (+ 365us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:42:22.311955 (+ 250us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:42:22.312729 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.314251 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.317728 (+ 3477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.318936 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.319118 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:22.319351 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0619 06:42:22.320842 (+ 1491us) server_negotiation.cc:299] Negotiation successful
0619 06:42:22.321037 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12751,"thread_start_us":12574,"threads_started":1}
I20260619 06:42:22.320681 27547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:22.299891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34484 (local address 127.10.192.65:32887)
0619 06:42:22.312278 (+ 12387us) server_negotiation.cc:206] Beginning negotiation
0619 06:42:22.312289 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:42:22.312326 (+ 37us) server_negotiation.cc:407] Connection header received
0619 06:42:22.312448 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:42:22.312457 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:42:22.312743 (+ 286us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:42:22.312974 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:42:22.313592 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.315184 (+ 1592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.317835 (+ 2651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.319428 (+ 1593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.319581 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:22.319851 (+ 270us) server_negotiation.cc:1035] Waiting for connection context
0619 06:42:22.320084 (+ 233us) server_negotiation.cc:299] Negotiation successful
0619 06:42:22.320270 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12169,"thread_start_us":12280,"threads_started":1}
I20260619 06:42:22.321497 27544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:22.299770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:38099 (local address 127.0.0.1:58500)
0619 06:42:22.312065 (+ 12295us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:22.312093 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0619 06:42:22.312258 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:42:22.313284 (+ 1026us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:42:22.313288 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:42:22.313313 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:42:22.313747 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:42:22.313760 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.315812 (+ 2052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.315836 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:42:22.318137 (+ 2301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:42:22.318150 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.320522 (+ 2372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.320531 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:42:22.320739 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:22.320774 (+ 35us) client_negotiation.cc:769] Sending connection context
0619 06:42:22.320882 (+ 108us) client_negotiation.cc:240] Negotiation successful
0619 06:42:22.321031 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12153,"mutex_wait_us":24,"thread_start_us":9206,"threads_started":1}
I20260619 06:42:22.322392 27546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:22.299817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58500 (local address 127.10.192.67:38099)
0619 06:42:22.311766 (+ 11949us) server_negotiation.cc:206] Beginning negotiation
0619 06:42:22.311777 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:42:22.312437 (+ 660us) server_negotiation.cc:407] Connection header received
0619 06:42:22.312537 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:42:22.312543 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:42:22.312743 (+ 200us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:42:22.312970 (+ 227us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:42:22.313954 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.315616 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.318317 (+ 2701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.319931 (+ 1614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.320096 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:22.320324 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0619 06:42:22.321812 (+ 1488us) server_negotiation.cc:299] Negotiation successful
0619 06:42:22.322020 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11695,"thread_start_us":11485,"threads_started":1}
I20260619 06:42:22.324803 27204 tablet_service.cc:1467] Processing CreateTablet for tablet 048682a8bde24aa0803033f1c4bee561 (DEFAULT_TABLE table=test-table [id=965391d9b0a44871b6590c47fe0d81f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:42:22.326046 27204 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 048682a8bde24aa0803033f1c4bee561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:42:22.326417 27336 tablet_service.cc:1467] Processing CreateTablet for tablet 048682a8bde24aa0803033f1c4bee561 (DEFAULT_TABLE table=test-table [id=965391d9b0a44871b6590c47fe0d81f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:42:22.326664 27467 tablet_service.cc:1467] Processing CreateTablet for tablet 048682a8bde24aa0803033f1c4bee561 (DEFAULT_TABLE table=test-table [id=965391d9b0a44871b6590c47fe0d81f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:42:22.328075 27336 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 048682a8bde24aa0803033f1c4bee561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:42:22.328073 27467 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 048682a8bde24aa0803033f1c4bee561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:42:22.334381 27548 tablet_bootstrap.cc:492] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6: Bootstrap starting.
I20260619 06:42:22.337757 27548 tablet_bootstrap.cc:654] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6: Neither blocks nor log segments found. Creating new log.
I20260619 06:42:22.339519 27548 log.cc:824] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6: Log is configured to *not* fsync() on all Append() calls
I20260619 06:42:22.342969 27548 tablet_bootstrap.cc:492] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6: No bootstrap required, opened a new log
I20260619 06:42:22.343258 27548 ts_tablet_manager.cc:1397] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260619 06:42:22.345971 27550 tablet_bootstrap.cc:492] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac: Bootstrap starting.
I20260619 06:42:22.346865 27551 tablet_bootstrap.cc:492] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd: Bootstrap starting.
I20260619 06:42:22.352248 27551 tablet_bootstrap.cc:654] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd: Neither blocks nor log segments found. Creating new log.
I20260619 06:42:22.353440 27551 log.cc:824] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd: Log is configured to *not* fsync() on all Append() calls
I20260619 06:42:22.353370 27548 raft_consensus.cc:348] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } } peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } }
I20260619 06:42:22.353905 27548 raft_consensus.cc:374] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:42:22.353983 27550 tablet_bootstrap.cc:654] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac: Neither blocks nor log segments found. Creating new log.
I20260619 06:42:22.354027 27548 raft_consensus.cc:729] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74f0abc397fe40bd905878ebee32b2f6, State: Initialized, Role: FOLLOWER
I20260619 06:42:22.354794 27548 consensus_queue.cc:260] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } } peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } }
I20260619 06:42:22.355298 27550 log.cc:824] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac: Log is configured to *not* fsync() on all Append() calls
I20260619 06:42:22.357365 27551 tablet_bootstrap.cc:492] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd: No bootstrap required, opened a new log
I20260619 06:42:22.357725 27551 ts_tablet_manager.cc:1397] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.001s
I20260619 06:42:22.357744 27548 ts_tablet_manager.cc:1428] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6: Time spent starting tablet: real 0.014s user 0.015s sys 0.000s
I20260619 06:42:22.359861 27550 tablet_bootstrap.cc:492] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac: No bootstrap required, opened a new log
I20260619 06:42:22.360139 27550 ts_tablet_manager.cc:1397] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.000s
I20260619 06:42:22.367992 27551 raft_consensus.cc:348] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } } peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } }
I20260619 06:42:22.368548 27551 raft_consensus.cc:374] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:42:22.368676 27551 raft_consensus.cc:729] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4caf8fdb029435982a4656f51e6c3dd, State: Initialized, Role: FOLLOWER
I20260619 06:42:22.368494 27550 raft_consensus.cc:348] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } } peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } }
I20260619 06:42:22.368965 27550 raft_consensus.cc:374] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:42:22.369089 27550 raft_consensus.cc:729] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76c633bb0e70489390ae5d27460d29ac, State: Initialized, Role: FOLLOWER
I20260619 06:42:22.369527 27551 consensus_queue.cc:260] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } } peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } }
I20260619 06:42:22.369689 27550 consensus_queue.cc:260] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } } peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } }
I20260619 06:42:22.371168 27532 heartbeater.cc:503] Master 127.10.192.126:35779 was elected leader, sending a full tablet report...
I20260619 06:42:22.371223 27401 heartbeater.cc:503] Master 127.10.192.126:35779 was elected leader, sending a full tablet report...
I20260619 06:42:22.371997 27550 ts_tablet_manager.cc:1428] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac: Time spent starting tablet: real 0.012s user 0.012s sys 0.000s
I20260619 06:42:22.372143 27551 ts_tablet_manager.cc:1428] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd: Time spent starting tablet: real 0.014s user 0.012s sys 0.003s
I20260619 06:42:22.376919 27556 raft_consensus.cc:482] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:42:22.377175 27556 raft_consensus.cc:504] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } } peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } }
I20260619 06:42:22.378919 27556 leader_election.cc:288] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 74f0abc397fe40bd905878ebee32b2f6 (127.10.192.65:32887), c4caf8fdb029435982a4656f51e6c3dd (127.10.192.67:38099)
I20260619 06:42:22.389777 27547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:22.379287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:50125 (local address 127.10.192.65:32887)
0619 06:42:22.379562 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0619 06:42:22.379570 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:42:22.381498 (+ 1928us) server_negotiation.cc:407] Connection header received
0619 06:42:22.381706 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:42:22.381711 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:42:22.381790 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:42:22.381891 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:42:22.382812 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.383950 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.387097 (+ 3147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.388408 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.388589 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:22.388669 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0619 06:42:22.389358 (+ 689us) server_negotiation.cc:299] Negotiation successful
0619 06:42:22.389506 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260619 06:42:22.389777 27546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:22.379394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:50077 (local address 127.10.192.67:38099)
0619 06:42:22.379575 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0619 06:42:22.379583 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:42:22.381495 (+ 1912us) server_negotiation.cc:407] Connection header received
0619 06:42:22.381706 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:42:22.381711 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:42:22.381790 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:42:22.381891 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:42:22.382759 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.383947 (+ 1188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.387112 (+ 3165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.388422 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.388589 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:22.388669 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0619 06:42:22.389358 (+ 689us) server_negotiation.cc:299] Negotiation successful
0619 06:42:22.389506 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260619 06:42:22.390170 27557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:22.379956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:32887 (local address 127.10.192.66:50125)
0619 06:42:22.381388 (+ 1432us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:22.381403 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 06:42:22.381536 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:42:22.381990 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:42:22.381994 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:42:22.382010 (+ 16us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:42:22.382646 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:42:22.382660 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.384098 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.384104 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:42:22.386907 (+ 2803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:42:22.386926 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.388718 (+ 1792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.388725 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:42:22.389055 (+ 330us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:22.389191 (+ 136us) client_negotiation.cc:769] Sending connection context
0619 06:42:22.389298 (+ 107us) client_negotiation.cc:240] Negotiation successful
0619 06:42:22.389617 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1310,"mutex_wait_us":525,"thread_start_us":481,"threads_started":1}
I20260619 06:42:22.390177 27558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:22.379925 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:38099 (local address 127.10.192.66:50077)
0619 06:42:22.381330 (+ 1405us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:22.381352 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 06:42:22.381571 (+ 219us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:42:22.381959 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:42:22.381965 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:42:22.381997 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:42:22.382553 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:42:22.382576 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.384098 (+ 1522us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.384104 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:42:22.386907 (+ 2803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:42:22.386926 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.388720 (+ 1794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.388725 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:42:22.389053 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:22.389194 (+ 141us) client_negotiation.cc:769] Sending connection context
0619 06:42:22.389298 (+ 104us) client_negotiation.cc:240] Negotiation successful
0619 06:42:22.389617 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1252,"mutex_wait_us":387,"spinlock_wait_cycles":25472,"thread_start_us":1050,"threads_started":1}
I20260619 06:42:22.391300 27224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "048682a8bde24aa0803033f1c4bee561" candidate_uuid: "76c633bb0e70489390ae5d27460d29ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74f0abc397fe40bd905878ebee32b2f6" is_pre_election: true
I20260619 06:42:22.391402 27487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "048682a8bde24aa0803033f1c4bee561" candidate_uuid: "76c633bb0e70489390ae5d27460d29ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4caf8fdb029435982a4656f51e6c3dd" is_pre_election: true
I20260619 06:42:22.391891 27224 raft_consensus.cc:2454] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76c633bb0e70489390ae5d27460d29ac in term 0.
I20260619 06:42:22.391904 27487 raft_consensus.cc:2454] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76c633bb0e70489390ae5d27460d29ac in term 0.
I20260619 06:42:22.392642 27292 leader_election.cc:302] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 74f0abc397fe40bd905878ebee32b2f6, 76c633bb0e70489390ae5d27460d29ac, c4caf8fdb029435982a4656f51e6c3dd; no voters:
I20260619 06:42:22.393103 27556 raft_consensus.cc:2781] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:42:22.393275 27556 raft_consensus.cc:482] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:42:22.393383 27556 raft_consensus.cc:3037] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:42:22.395743 27556 raft_consensus.cc:504] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } } peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } }
I20260619 06:42:22.396409 27556 leader_election.cc:288] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [CANDIDATE]: Term 1 election: Requested vote from peers 74f0abc397fe40bd905878ebee32b2f6 (127.10.192.65:32887), c4caf8fdb029435982a4656f51e6c3dd (127.10.192.67:38099)
I20260619 06:42:22.397090 27224 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "048682a8bde24aa0803033f1c4bee561" candidate_uuid: "76c633bb0e70489390ae5d27460d29ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "74f0abc397fe40bd905878ebee32b2f6"
I20260619 06:42:22.397091 27487 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "048682a8bde24aa0803033f1c4bee561" candidate_uuid: "76c633bb0e70489390ae5d27460d29ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4caf8fdb029435982a4656f51e6c3dd"
I20260619 06:42:22.397334 27487 raft_consensus.cc:3037] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:42:22.397334 27224 raft_consensus.cc:3037] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:42:22.400790 27224 raft_consensus.cc:2454] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76c633bb0e70489390ae5d27460d29ac in term 1.
I20260619 06:42:22.400790 27487 raft_consensus.cc:2454] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76c633bb0e70489390ae5d27460d29ac in term 1.
I20260619 06:42:22.401331 27292 leader_election.cc:302] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 74f0abc397fe40bd905878ebee32b2f6, 76c633bb0e70489390ae5d27460d29ac, c4caf8fdb029435982a4656f51e6c3dd; no voters:
I20260619 06:42:22.401690 27556 raft_consensus.cc:2781] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:42:22.402132 27556 raft_consensus.cc:686] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [term 1 LEADER]: Becoming Leader. State: Replica: 76c633bb0e70489390ae5d27460d29ac, State: Running, Role: LEADER
I20260619 06:42:22.402648 27556 consensus_queue.cc:237] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } } peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } }
I20260619 06:42:22.407768 27083 catalog_manager.cc:5495] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 76c633bb0e70489390ae5d27460d29ac (127.10.192.66). New cstate: current_term: 1 leader_uuid: "76c633bb0e70489390ae5d27460d29ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76c633bb0e70489390ae5d27460d29ac" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 40079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 } health_report { overall_health: UNKNOWN } } }
I20260619 06:42:22.437182 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:22.431685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47912 (local address 127.10.192.66:40079)
0619 06:42:22.431881 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0619 06:42:22.431885 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:42:22.431902 (+ 17us) server_negotiation.cc:407] Connection header received
0619 06:42:22.432098 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:42:22.432102 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:42:22.432187 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:42:22.432310 (+ 123us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:42:22.432660 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.433366 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.434789 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.435277 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.435385 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:22.436053 (+ 668us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:42:22.436576 (+ 523us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:42:22.436703 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0619 06:42:22.436780 (+ 77us) server_negotiation.cc:299] Negotiation successful
0619 06:42:22.436857 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260619 06:42:22.446424 27487 raft_consensus.cc:1261] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd [term 1 FOLLOWER]: Refusing update from remote peer 76c633bb0e70489390ae5d27460d29ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:42:22.446429 27224 raft_consensus.cc:1261] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6 [term 1 FOLLOWER]: Refusing update from remote peer 76c633bb0e70489390ae5d27460d29ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:42:22.447671 27559 consensus_queue.cc:1035] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "74f0abc397fe40bd905878ebee32b2f6" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 32887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:42:22.448071 27556 consensus_queue.cc:1035] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "c4caf8fdb029435982a4656f51e6c3dd" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:42:22.479084 27083 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57914:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:42:22.479400 27083 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57914:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:42:22.483206 27083 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef: Sending DeleteTablet for 3 replicas of tablet 048682a8bde24aa0803033f1c4bee561
I20260619 06:42:22.484731 27467 tablet_service.cc:1514] Processing DeleteTablet for tablet 048682a8bde24aa0803033f1c4bee561 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:42:22 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:58500
I20260619 06:42:22.484755 27204 tablet_service.cc:1514] Processing DeleteTablet for tablet 048682a8bde24aa0803033f1c4bee561 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:42:22 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:34484
I20260619 06:42:22.486141 27336 tablet_service.cc:1514] Processing DeleteTablet for tablet 048682a8bde24aa0803033f1c4bee561 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:42:22 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:47900
I20260619 06:42:22.487498 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 27120
I20260619 06:42:22.497035 27573 tablet_replica.cc:330] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6: stopping tablet replica
I20260619 06:42:22.497076 27572 tablet_replica.cc:330] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd: stopping tablet replica
I20260619 06:42:22.497637 27573 raft_consensus.cc:2229] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:42:22.498027 27572 raft_consensus.cc:2229] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:42:22.498252 27573 raft_consensus.cc:2258] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:42:22.498667 27574 tablet_replica.cc:330] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac: stopping tablet replica
I20260619 06:42:22.498665 27572 raft_consensus.cc:2258] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:42:22.499083 27574 raft_consensus.cc:2229] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:42:22.499898 27574 raft_consensus.cc:2258] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:42:22.501392 27572 ts_tablet_manager.cc:1905] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:42:22.501379 27573 ts_tablet_manager.cc:1905] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:42:22.508733 27573 ts_tablet_manager.cc:1918] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:42:22.508733 27572 ts_tablet_manager.cc:1918] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:42:22.508906 27573 log.cc:1196] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/048682a8bde24aa0803033f1c4bee561
I20260619 06:42:22.509397 27573 ts_tablet_manager.cc:1939] T 048682a8bde24aa0803033f1c4bee561 P 74f0abc397fe40bd905878ebee32b2f6: Deleting consensus metadata
I20260619 06:42:22.510711 27574 ts_tablet_manager.cc:1905] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:42:22.511526 27069 catalog_manager.cc:4841] TS 74f0abc397fe40bd905878ebee32b2f6 (127.10.192.65:32887): tablet 048682a8bde24aa0803033f1c4bee561 (table test-table [id=965391d9b0a44871b6590c47fe0d81f7]) successfully deleted
I20260619 06:42:22.512104 27572 log.cc:1196] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/048682a8bde24aa0803033f1c4bee561
I20260619 06:42:22.512698 27547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:22.489806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34486 (local address 127.10.192.65:32887)
0619 06:42:22.490052 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0619 06:42:22.490061 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:42:22.490086 (+ 25us) server_negotiation.cc:407] Connection header received
0619 06:42:22.490167 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:42:22.490175 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:42:22.490296 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:42:22.490420 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:42:22.493161 (+ 2741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.494802 (+ 1641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.497453 (+ 2651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.498166 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.498336 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:22.503234 (+ 4898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:42:22.503250 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:42:22.503269 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:42:22.503323 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:42:22.507809 (+ 4486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:42:22.508914 (+ 1105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:42:22.508925 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:42:22.508929 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:42:22.509149 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:42:22.509659 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:42:22.509665 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:42:22.509668 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:42:22.510207 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:42:22.511812 (+ 1605us) server_negotiation.cc:1035] Waiting for connection context
0619 06:42:22.511977 (+ 165us) server_negotiation.cc:299] Negotiation successful
0619 06:42:22.512278 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260619 06:42:22.512712 27572 ts_tablet_manager.cc:1939] T 048682a8bde24aa0803033f1c4bee561 P c4caf8fdb029435982a4656f51e6c3dd: Deleting consensus metadata
I20260619 06:42:22.513464 27264 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:42:22.514605 27070 catalog_manager.cc:4841] TS c4caf8fdb029435982a4656f51e6c3dd (127.10.192.67:38099): tablet 048682a8bde24aa0803033f1c4bee561 (table test-table [id=965391d9b0a44871b6590c47fe0d81f7]) successfully deleted
I20260619 06:42:22.519515 27574 ts_tablet_manager.cc:1918] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:42:22.519759 27574 log.cc:1196] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/048682a8bde24aa0803033f1c4bee561
I20260619 06:42:22.520267 27574 ts_tablet_manager.cc:1939] T 048682a8bde24aa0803033f1c4bee561 P 76c633bb0e70489390ae5d27460d29ac: Deleting consensus metadata
I20260619 06:42:22.521876 27069 catalog_manager.cc:4841] TS 76c633bb0e70489390ae5d27460d29ac (127.10.192.66:40079): tablet 048682a8bde24aa0803033f1c4bee561 (table test-table [id=965391d9b0a44871b6590c47fe0d81f7]) successfully deleted
I20260619 06:42:22.611601 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 27120
I20260619 06:42:22.629866 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 27273
I20260619 06:42:22.646234 27543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:22.630736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47916 (local address 127.10.192.66:40079)
0619 06:42:22.630915 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0619 06:42:22.630920 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:42:22.630975 (+ 55us) server_negotiation.cc:407] Connection header received
0619 06:42:22.631212 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:42:22.631217 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:42:22.631315 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:42:22.631404 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:42:22.633399 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.634241 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.635582 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.636093 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.636226 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:22.639170 (+ 2944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:42:22.639190 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:42:22.639211 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:42:22.639266 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:42:22.642835 (+ 3569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:42:22.643885 (+ 1050us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:42:22.643894 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:42:22.643896 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:42:22.644076 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:42:22.644499 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:42:22.644510 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:42:22.644513 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:42:22.644933 (+ 420us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:42:22.645291 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0619 06:42:22.645612 (+ 321us) server_negotiation.cc:299] Negotiation successful
0619 06:42:22.645849 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260619 06:42:22.647210 27396 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:42:22.777904 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 27273
I20260619 06:42:22.797283 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 27404
I20260619 06:42:22.811259 27546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:22.798101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58516 (local address 127.10.192.67:38099)
0619 06:42:22.798277 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0619 06:42:22.798282 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:42:22.798377 (+ 95us) server_negotiation.cc:407] Connection header received
0619 06:42:22.798540 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:42:22.798544 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:42:22.798628 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:42:22.798714 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:42:22.800160 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.800939 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.802218 (+ 1279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:42:22.802597 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:42:22.802683 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:42:22.805365 (+ 2682us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:42:22.805380 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:42:22.805396 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:42:22.805431 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:42:22.808420 (+ 2989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:42:22.809191 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:42:22.809199 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:42:22.809201 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:42:22.809340 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:42:22.809740 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:42:22.809743 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:42:22.809745 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:42:22.810092 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:42:22.810328 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0619 06:42:22.810729 (+ 401us) server_negotiation.cc:299] Negotiation successful
0619 06:42:22.810905 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260619 06:42:22.811924 27527 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:42:22.903205 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 27404
I20260619 06:42:22.920140 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 27050
I20260619 06:42:22.921310 27113 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:42:23.037809 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 27050
I20260619 06:42:43.060150 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:35779
--webserver_interface=127.10.192.126
--webserver_port=35325
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:41323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:35779
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:42:43.396482 27579 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:42:43.396771 27579 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:42:43.396875 27579 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:42:43.404379 27579 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260619 06:42:43.404481 27579 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260619 06:42:43.404518 27579 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260619 06:42:43.404563 27579 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:42:43.404618 27579 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:42:43.404685 27579 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:42:43.404740 27579 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:42:43.404791 27579 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:42:43.415486 27579 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:41323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:35779
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:35779
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=35325
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:42:43.416863 27579 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:42:43.418313 27579 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:42:43.430974 27584 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:42:43.430946 27585 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:42:43.431061 27587 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:42:43.431011 27579 server_base.cc:1034] running on GCE node
I20260619 06:42:43.432317 27579 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:42:43.433815 27579 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:42:43.435097 27579 hybrid_clock.cc:648] HybridClock initialized: now 1781851363435029 us; error 44 us; skew 500 ppm
I20260619 06:42:43.435463 27579 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:42:43 dist-test-slave-7lz4 krb5kdc[26499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851363, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:42:43.446429 27579 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:42:43.448372 27579 webserver.cc:460] Webserver started at http://127.10.192.126:35325/ using document root <none> and password file <none>
I20260619 06:42:43.449172 27579 fs_manager.cc:359] Metadata directory not provided
I20260619 06:42:43.449317 27579 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:42:43.455407 27579 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.000s
I20260619 06:42:43.458492 27594 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:42:43.460095 27579 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:42:43.460301 27579 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "1628f24adb7b4063b4b59fbfcec676ef"
format_stamp: "Formatted at 2026-06-19 06:41:57 on dist-test-slave-7lz4"
server_key: "d175e49792b2938c59b87d2410299694"
server_key_iv: "34e59f47fb1903e8743a522cab651a49"
server_key_version: "encryptionkey@0"
I20260619 06:42:43.461326 27579 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:42:43.509349 27579 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:42:43.514600 27579 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:42:43.514914 27579 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:42:43.534749 27579 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:35779
I20260619 06:42:43.534802 27645 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:35779 every 8 connection(s)
I20260619 06:42:43.536477 27579 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:42:43.543483 27646 sys_catalog.cc:263] Verifying existing consensus state
I20260619 06:42:43.546446 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 27579
I20260619 06:42:43.546931 27646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef: Bootstrap starting.
I20260619 06:42:43.547395 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:32887
--local_ip_for_outbound_sockets=127.10.192.65
--tserver_master_addrs=127.10.192.126:35779
--webserver_port=33537
--webserver_interface=127.10.192.65
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:41323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:42:43.569358 27646 log.cc:824] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef: Log is configured to *not* fsync() on all Append() calls
I20260619 06:42:43.585690 27646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260619 06:42:43.586283 27646 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef: Bootstrap complete.
I20260619 06:42:43.595491 27646 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1628f24adb7b4063b4b59fbfcec676ef" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35779 } }
I20260619 06:42:43.596561 27646 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1628f24adb7b4063b4b59fbfcec676ef, State: Initialized, Role: FOLLOWER
I20260619 06:42:43.597254 27646 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1628f24adb7b4063b4b59fbfcec676ef" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35779 } }
I20260619 06:42:43.597540 27646 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:42:43.597699 27646 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:42:43.597882 27646 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 2 FOLLOWER]: Advancing to term 3
I20260619 06:42:43.601962 27646 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1628f24adb7b4063b4b59fbfcec676ef" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35779 } }
I20260619 06:42:43.602499 27646 leader_election.cc:302] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1628f24adb7b4063b4b59fbfcec676ef; no voters:
I20260619 06:42:43.603206 27646 leader_election.cc:288] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [CANDIDATE]: Term 3 election: Requested vote from peers
I20260619 06:42:43.603364 27650 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 3 FOLLOWER]: Leader election won for term 3
I20260619 06:42:43.604820 27650 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [term 3 LEADER]: Becoming Leader. State: Replica: 1628f24adb7b4063b4b59fbfcec676ef, State: Running, Role: LEADER
I20260619 06:42:43.605463 27650 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1628f24adb7b4063b4b59fbfcec676ef" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35779 } }
I20260619 06:42:43.605744 27646 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:42:43.608217 27651 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "1628f24adb7b4063b4b59fbfcec676ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1628f24adb7b4063b4b59fbfcec676ef" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35779 } } }
I20260619 06:42:43.608619 27651 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [sys.catalog]: This master's current role is: LEADER
I20260619 06:42:43.609198 27652 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1628f24adb7b4063b4b59fbfcec676ef. Latest consensus state: current_term: 3 leader_uuid: "1628f24adb7b4063b4b59fbfcec676ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1628f24adb7b4063b4b59fbfcec676ef" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 35779 } } }
I20260619 06:42:43.609504 27652 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef [sys.catalog]: This master's current role is: LEADER
I20260619 06:42:43.620234 27657 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:42:43.627285 27657 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:42:43.628554 27657 catalog_manager.cc:1259] Loaded cluster ID: 110fcb7b919e4f33a137a3e7e0087b1d
I20260619 06:42:43.628675 27657 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:42:43.631543 27657 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:42:43.632743 27657 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef: Loaded TSK: 0
I20260619 06:42:43.632905 27657 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1628f24adb7b4063b4b59fbfcec676ef: Loaded TSK: 1
F20260619 06:42:43.633769 27657 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fa535b619ad google::LogMessage::Fail() at ??:0
@ 0x7fa535b6488a google::LogMessage::SendToLog() at ??:0
@ 0x7fa535b614de google::LogMessage::Flush() at ??:0
@ 0x7fa535b62a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fa5398c57d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fa5398b473e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fa54b5901c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fa54b58f783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fa54b61b2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7fa54b61b0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7fa54b6655e9 std::function<>::operator()() at ??:0
@ 0x7fa54b593cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fa54b591c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fa54b619610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fa54b619439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fa5387ad345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fa5387b091c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fa5387b0799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fa53878beaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fa53ba656db start_thread at ??:0
@ 0x7fa5349fb61f clone at ??:0
W20260619 06:42:43.928866 27648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:42:43.929234 27648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:42:43.929410 27648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:42:43.936959 27648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:42:43.937079 27648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:42:43.937305 27648 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:42:43.947392 27648 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:41323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:32887
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=33537
--tserver_master_addrs=127.10.192.126:35779
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:42:43.948855 27648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:42:43.950479 27648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:42:43.964689 27694 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:42:43.964721 27696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:42:43.964784 27693 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:42:43.966010 27648 server_base.cc:1034] running on GCE node
I20260619 06:42:43.966831 27648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:42:43.968036 27648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:42:43.969302 27648 hybrid_clock.cc:648] HybridClock initialized: now 1781851363969247 us; error 70 us; skew 500 ppm
I20260619 06:42:43.969684 27648 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:42:43 dist-test-slave-7lz4 krb5kdc[26499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851363, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:42:43.973415 27648 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:42:43.975157 27648 webserver.cc:460] Webserver started at http://127.10.192.65:33537/ using document root <none> and password file <none>
I20260619 06:42:43.975947 27648 fs_manager.cc:359] Metadata directory not provided
I20260619 06:42:43.976099 27648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:42:43.981980 27648 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260619 06:42:43.985179 27703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:42:43.986796 27648 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260619 06:42:43.986990 27648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "74f0abc397fe40bd905878ebee32b2f6"
format_stamp: "Formatted at 2026-06-19 06:41:58 on dist-test-slave-7lz4"
server_key: "5184d01f360eec82fa86089ed9ec32f5"
server_key_iv: "dfe1417daaf034ec9f6bf74452355a9c"
server_key_version: "encryptionkey@0"
I20260619 06:42:43.988169 27648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:42:44.009399 27648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:42:44.014468 27648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:42:44.014787 27648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:42:44.015928 27648 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:42:44.017315 27648 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:42:44.017465 27648 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:42:44.017635 27648 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:42:44.017735 27648 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:42:44.061000 27648 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:32887
I20260619 06:42:44.061129 27815 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:32887 every 8 connection(s)
I20260619 06:42:44.063009 27648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:42:44.063851 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 27648
I20260619 06:42:44.064661 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:40079
--local_ip_for_outbound_sockets=127.10.192.66
--tserver_master_addrs=127.10.192.126:35779
--webserver_port=33379
--webserver_interface=127.10.192.66
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:41323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:42:44.069263 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:44.066413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:55695)
0619 06:42:44.067233 (+ 820us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:44.067488 (+ 255us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":351,"threads_started":1}
W20260619 06:42:44.072827 27816 heartbeater.cc:644] Failed to heartbeat to 127.10.192.126:35779 (0 consecutive failures): Network error: Failed to ping master at 127.10.192.126:35779: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
I20260619 06:42:44.074478 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:44.073949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:54885)
0619 06:42:44.074137 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:44.074278 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260619 06:42:44.075524 27818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:44.075090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:48391)
0619 06:42:44.075269 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:44.075370 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260619 06:42:44.078444 27816 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260619 06:42:44.402366 27819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:42:44.402637 27819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:42:44.402730 27819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:42:44.409833 27819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:42:44.409951 27819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:42:44.410069 27819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:42:44.419838 27819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:41323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:40079
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=33379
--tserver_master_addrs=127.10.192.126:35779
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:42:44.421123 27819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:42:44.422390 27819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:42:44.436213 27824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:42:44.436268 27827 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:42:44.436185 27825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:42:44.437351 27819 server_base.cc:1034] running on GCE node
I20260619 06:42:44.437988 27819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:42:44.438962 27819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:42:44.440191 27819 hybrid_clock.cc:648] HybridClock initialized: now 1781851364440142 us; error 43 us; skew 500 ppm
I20260619 06:42:44.440517 27819 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:42:44 dist-test-slave-7lz4 krb5kdc[26499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851364, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:42:44.443574 27819 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:42:44.445096 27819 webserver.cc:460] Webserver started at http://127.10.192.66:33379/ using document root <none> and password file <none>
I20260619 06:42:44.445776 27819 fs_manager.cc:359] Metadata directory not provided
I20260619 06:42:44.445928 27819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:42:44.451440 27819 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260619 06:42:44.454205 27834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:42:44.455603 27819 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 06:42:44.455832 27819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "76c633bb0e70489390ae5d27460d29ac"
format_stamp: "Formatted at 2026-06-19 06:41:58 on dist-test-slave-7lz4"
server_key: "6ff8527fc1175b50de07aec4701a962a"
server_key_iv: "1b3191ef1e9390840b84367a7e4ec3af"
server_key_version: "encryptionkey@0"
I20260619 06:42:44.456852 27819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:42:44.511550 27819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:42:44.515769 27819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:42:44.516072 27819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:42:44.517128 27819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:42:44.518543 27819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:42:44.518662 27819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:42:44.518800 27819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:42:44.518887 27819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:42:44.552912 27819 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:40079
I20260619 06:42:44.552980 27946 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:40079 every 8 connection(s)
I20260619 06:42:44.554419 27819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:42:44.556671 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 27819
I20260619 06:42:44.557303 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:38099
--local_ip_for_outbound_sockets=127.10.192.67
--tserver_master_addrs=127.10.192.126:35779
--webserver_port=45191
--webserver_interface=127.10.192.67
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:41323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:42:44.560362 27949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:44.557885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:48167)
0619 06:42:44.558752 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:44.559052 (+ 300us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":295,"threads_started":1}
W20260619 06:42:44.561168 27947 heartbeater.cc:644] Failed to heartbeat to 127.10.192.126:35779 (0 consecutive failures): Network error: Failed to ping master at 127.10.192.126:35779: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
I20260619 06:42:44.562187 27949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:44.561735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:36469)
0619 06:42:44.561935 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:44.562034 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260619 06:42:44.563215 27949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:44.562777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:36237)
0619 06:42:44.562957 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:44.563059 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260619 06:42:44.563493 27947 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260619 06:42:44.889926 27950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:42:44.890233 27950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:42:44.890394 27950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:42:44.897838 27950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:42:44.897959 27950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:42:44.898185 27950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:42:44.908205 27950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:41323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:38099
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=45191
--tserver_master_addrs=127.10.192.126:35779
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:42:44.909591 27950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:42:44.911031 27950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:42:44.924175 27956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:42:44.924156 27955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:42:44.924149 27958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:42:44.925220 27950 server_base.cc:1034] running on GCE node
I20260619 06:42:44.925812 27950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:42:44.926731 27950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:42:44.927966 27950 hybrid_clock.cc:648] HybridClock initialized: now 1781851364927926 us; error 56 us; skew 500 ppm
I20260619 06:42:44.928287 27950 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:42:44 dist-test-slave-7lz4 krb5kdc[26499](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851364, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:42:44.931447 27950 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:42:44.932981 27950 webserver.cc:460] Webserver started at http://127.10.192.67:45191/ using document root <none> and password file <none>
I20260619 06:42:44.933605 27950 fs_manager.cc:359] Metadata directory not provided
I20260619 06:42:44.933702 27950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:42:44.938845 27950 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260619 06:42:44.941568 27965 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:42:44.942917 27950 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260619 06:42:44.943053 27950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "c4caf8fdb029435982a4656f51e6c3dd"
format_stamp: "Formatted at 2026-06-19 06:41:59 on dist-test-slave-7lz4"
server_key: "ba19e8c0fd2c597f501ccc21b97f819e"
server_key_iv: "b036f261cb3aff0c69dcec151c72fd03"
server_key_version: "encryptionkey@0"
I20260619 06:42:44.944077 27950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:42:44.956413 27950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:42:44.961170 27950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:42:44.961454 27950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:42:44.962460 27950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:42:44.963886 27950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:42:44.963984 27950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:42:44.964056 27950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:42:44.964109 27950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:42:44.998849 27950 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:38099
I20260619 06:42:44.998909 28077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:38099 every 8 connection(s)
I20260619 06:42:45.000514 27950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:42:45.002727 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 27950
I20260619 06:42:45.005960 28081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:45.003960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:55607)
0619 06:42:45.004835 (+ 875us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:45.005062 (+ 227us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":322,"threads_started":1}
W20260619 06:42:45.006567 28078 heartbeater.cc:644] Failed to heartbeat to 127.10.192.126:35779 (0 consecutive failures): Network error: Failed to ping master at 127.10.192.126:35779: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
I20260619 06:42:45.007385 28081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:45.007063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:57931)
0619 06:42:45.007209 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:45.007283 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260619 06:42:45.008270 28081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:45.007951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:60799)
0619 06:42:45.008088 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:45.008170 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260619 06:42:45.008512 28078 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260619 06:42:45.079852 28082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:45.078992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:36037)
0619 06:42:45.079438 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:45.079548 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":338,"thread_start_us":210,"threads_started":1}
I20260619 06:42:45.564965 28083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:45.564126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:52647)
0619 06:42:45.564605 (+ 479us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:45.564700 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":230,"threads_started":1}
I20260619 06:42:46.009913 28084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:46.009093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:52687)
0619 06:42:46.009580 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:46.009668 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":371,"thread_start_us":224,"threads_started":1}
I20260619 06:42:46.081760 28085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:46.080882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:39765)
0619 06:42:46.081434 (+ 552us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:46.081514 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":313,"threads_started":1}
I20260619 06:42:46.566727 28086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:46.565979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:38923)
0619 06:42:46.566488 (+ 509us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:46.566569 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":298,"threads_started":1}
I20260619 06:42:47.011767 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:47.010924 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:57881)
0619 06:42:47.011435 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:47.011523 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":260,"threads_started":1}
I20260619 06:42:47.083521 28088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:47.082799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:54053)
0619 06:42:47.083251 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:47.083341 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":243,"threads_started":1}
I20260619 06:42:47.568567 28089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:47.567764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:53221)
0619 06:42:47.568294 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:47.568376 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":402,"thread_start_us":293,"threads_started":1}
I20260619 06:42:48.013938 28090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:48.012880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:36157)
0619 06:42:48.013511 (+ 631us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:48.013691 (+ 180us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":336,"threads_started":1}
I20260619 06:42:48.085194 28091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:48.084486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:43177)
0619 06:42:48.084938 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:48.085022 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":341,"thread_start_us":222,"threads_started":1}
I20260619 06:42:48.570251 28092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:48.569518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:40485)
0619 06:42:48.569992 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:48.570082 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":238,"threads_started":1}
I20260619 06:42:49.015596 28093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:49.014837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:41079)
0619 06:42:49.015294 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:49.015377 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":233,"threads_started":1}
I20260619 06:42:49.087128 28094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:49.086386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:57339)
0619 06:42:49.086838 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:49.086951 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":354,"thread_start_us":226,"threads_started":1}
I20260619 06:42:49.572021 28095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:49.571233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:52545)
0619 06:42:49.571755 (+ 522us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:49.571848 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":234,"threads_started":1}
I20260619 06:42:50.017541 28096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:50.016719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:57861)
0619 06:42:50.017263 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:50.017352 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":326,"threads_started":1}
I20260619 06:42:50.088879 28097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:50.088095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:44853)
0619 06:42:50.088622 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:50.088714 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":277,"threads_started":1}
I20260619 06:42:50.573764 28098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:50.573018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:55717)
0619 06:42:50.573502 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:50.573598 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":251,"threads_started":1}
I20260619 06:42:51.019507 28099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:51.018628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:39725)
0619 06:42:51.019194 (+ 566us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:51.019291 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":446,"thread_start_us":321,"threads_started":1}
I20260619 06:42:51.090721 28100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:51.089839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:38457)
0619 06:42:51.090407 (+ 568us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:51.090503 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":211,"threads_started":1}
I20260619 06:42:51.575838 28101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:51.574896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:36399)
0619 06:42:51.575450 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:51.575548 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":257,"threads_started":1}
I20260619 06:42:52.021440 28102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:52.020613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:45659)
0619 06:42:52.021113 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:52.021202 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":238,"threads_started":1}
I20260619 06:42:52.092689 28103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:52.091822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:43103)
0619 06:42:52.092275 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:52.092431 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":231,"threads_started":1}
I20260619 06:42:52.577859 28104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:52.576891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:49653)
0619 06:42:52.577492 (+ 601us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:52.577615 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":337,"threads_started":1}
I20260619 06:42:53.023191 28105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:53.022444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:40871)
0619 06:42:53.022927 (+ 483us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:53.023023 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":256,"threads_started":1}
I20260619 06:42:53.094771 28106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:53.093743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:45571)
0619 06:42:53.094397 (+ 654us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:53.094549 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":483,"thread_start_us":348,"threads_started":1}
I20260619 06:42:53.579833 28107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:53.578889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:44551)
0619 06:42:53.579493 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:53.579580 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":311,"threads_started":1}
I20260619 06:42:54.025189 28108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:54.024370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:50561)
0619 06:42:54.024924 (+ 554us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:54.025011 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":286,"threads_started":1}
I20260619 06:42:54.096414 28109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:54.095696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:36611)
0619 06:42:54.096165 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:54.096247 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":248,"threads_started":1}
I20260619 06:42:54.581676 28110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:54.580848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:43571)
0619 06:42:54.581359 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:54.581478 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":366,"thread_start_us":233,"threads_started":1}
I20260619 06:42:55.027235 28111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:55.026191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:35239)
0619 06:42:55.026861 (+ 670us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:55.026983 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":507,"thread_start_us":366,"threads_started":1}
I20260619 06:42:55.098225 28112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:55.097502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:35105)
0619 06:42:55.097948 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:55.098047 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":343,"thread_start_us":209,"threads_started":1}
I20260619 06:42:55.583630 28113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:55.582716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:36157)
0619 06:42:55.583220 (+ 504us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:55.583330 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":277,"threads_started":1}
I20260619 06:42:56.029284 28114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:56.028397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:38583)
0619 06:42:56.028946 (+ 549us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:56.029039 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":401,"thread_start_us":274,"threads_started":1}
I20260619 06:42:56.099979 28115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:56.099188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:55213)
0619 06:42:56.099725 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:56.099811 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":271,"threads_started":1}
I20260619 06:42:56.585444 28116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:56.584767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:48247)
0619 06:42:56.585203 (+ 436us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:56.585286 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":330,"thread_start_us":224,"threads_started":1}
I20260619 06:42:57.031319 28117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:57.030434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:55863)
0619 06:42:57.031007 (+ 573us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:57.031101 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":286,"threads_started":1}
I20260619 06:42:57.101804 28118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:57.100880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:46539)
0619 06:42:57.101490 (+ 610us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:57.101595 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":333,"threads_started":1}
I20260619 06:42:57.587549 28119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:57.586706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:36897)
0619 06:42:57.587249 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:57.587359 (+ 110us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433,"thread_start_us":296,"threads_started":1}
I20260619 06:42:58.033478 28120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:58.032507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:36357)
0619 06:42:58.033150 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:58.033289 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":336,"threads_started":1}
I20260619 06:42:58.103845 28121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:58.102976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:33475)
0619 06:42:58.103503 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:58.103606 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":400,"thread_start_us":261,"threads_started":1}
I20260619 06:42:58.589502 28122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:58.588668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:48695)
0619 06:42:58.589213 (+ 545us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:58.589304 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":426,"thread_start_us":303,"threads_started":1}
I20260619 06:42:59.035581 28123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:59.034504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:45081)
0619 06:42:59.035170 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:59.035325 (+ 155us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":293,"threads_started":1}
I20260619 06:42:59.105584 28124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:59.104906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.65:33811)
0619 06:42:59.105309 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:59.105406 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":305,"thread_start_us":209,"threads_started":1}
I20260619 06:42:59.591889 28125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:42:59.590982 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.66:59147)
0619 06:42:59.591516 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0619 06:42:59.591697 (+ 181us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":313,"threads_started":1}
I20260619 06:43:00.008638 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 27648
I20260619 06:43:00.033052 28126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:00.010037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44276 (local address 127.10.192.65:32887)
0619 06:43:00.011172 (+ 1135us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:00.011187 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:00.011227 (+ 40us) server_negotiation.cc:407] Connection header received
0619 06:43:00.012907 (+ 1680us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:00.012918 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:00.013468 (+ 550us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:00.013829 (+ 361us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:00.015345 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:00.016647 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:00.017948 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:00.018636 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:00.018838 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:00.025919 (+ 7081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:00.025930 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:00.025948 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:00.026001 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:00.029206 (+ 3205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:00.030035 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:00.030044 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:00.030053 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:00.030244 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:00.030697 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:00.030703 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:00.030707 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:00.031312 (+ 605us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:00.031685 (+ 373us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:00.032237 (+ 552us) server_negotiation.cc:299] Negotiation successful
0619 06:43:00.032719 (+ 482us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":987,"thread_start_us":332,"threads_started":1}
I20260619 06:43:00.034638 27811 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:00.037997 28128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:00.037003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:35779 (local address 127.10.192.67:49631)
0619 06:43:00.037581 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:00.037726 (+ 145us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.126:35779: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421,"thread_start_us":287,"threads_started":1}
I20260619 06:43:00.121289 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 27648
I20260619 06:43:00.139436 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 27819
I20260619 06:43:00.158149 28130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:00.140479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45384 (local address 127.10.192.66:40079)
0619 06:43:00.141062 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:00.141075 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:00.141112 (+ 37us) server_negotiation.cc:407] Connection header received
0619 06:43:00.142733 (+ 1621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:00.142743 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:00.143199 (+ 456us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:00.143575 (+ 376us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:00.145120 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:00.146332 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:00.148223 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:00.148953 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:00.149169 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:00.151983 (+ 2814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:00.151990 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:00.152006 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:00.152046 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:00.154792 (+ 2746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:00.155481 (+ 689us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:00.155488 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:00.155495 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:00.155729 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:00.156109 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:00.156115 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:00.156118 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:00.156641 (+ 523us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:00.156976 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:00.157415 (+ 439us) server_negotiation.cc:299] Negotiation successful
0619 06:43:00.157868 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":418,"thread_start_us":268,"threads_started":1}
I20260619 06:43:00.159590 27942 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:00.244730 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 27819
I20260619 06:43:00.262852 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 27950
I20260619 06:43:00.281157 28132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:00.263859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50810 (local address 127.10.192.67:38099)
0619 06:43:00.264491 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:00.264507 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:00.264551 (+ 44us) server_negotiation.cc:407] Connection header received
0619 06:43:00.266240 (+ 1689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:00.266250 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:00.266710 (+ 460us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:00.267006 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:00.268439 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:00.269688 (+ 1249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:00.270921 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:00.271590 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:00.271815 (+ 225us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:00.274717 (+ 2902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:00.274726 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:00.274743 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:00.274783 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:00.277764 (+ 2981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:00.278574 (+ 810us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:00.278582 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:00.278589 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:00.278759 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:00.279157 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:00.279160 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:00.279162 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:00.279803 (+ 641us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:00.280029 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:00.280424 (+ 395us) server_negotiation.cc:299] Negotiation successful
0619 06:43:00.280859 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":458,"thread_start_us":309,"threads_started":1}
I20260619 06:43:00.282538 28073 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:00.367115 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 27950
2026-06-19T06:43:00Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (64477 ms)
[----------] 30 tests from SecurityITest (299757 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:00 dist-test-slave-7lz4 krb5kdc[28136](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:00 dist-test-slave-7lz4 krb5kdc[28136](info): set up 2 sockets
Jun 19 06:43:00 dist-test-slave-7lz4 krb5kdc[28136](info): commencing operation
krb5kdc: starting...
W20260619 06:43:01.479902 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.073s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:01 dist-test-slave-7lz4 krb5kdc[28136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851381, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:43:01.738952 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:33377
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:37967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:33377
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:02.080338 28149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:02.080684 28149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:02.080875 28149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:02.088660 28149 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:02.088792 28149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:02.088897 28149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:02.088994 28149 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:02.089071 28149 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:02.099730 28149 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:37967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:33377
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:33377
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:02.101178 28149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:02.102640 28149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:02.115309 28155 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:02.115468 28154 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:02.115998 28157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:02.116258 28149 server_base.cc:1034] running on GCE node
I20260619 06:43:02.117115 28149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:02.118692 28149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:02.119994 28149 hybrid_clock.cc:648] HybridClock initialized: now 1781851382119924 us; error 68 us; skew 500 ppm
I20260619 06:43:02.120379 28149 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:02 dist-test-slave-7lz4 krb5kdc[28136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851382, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:02.123723 28149 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:43:02.125484 28149 webserver.cc:460] Webserver started at http://127.10.192.126:38269/ using document root <none> and password file <none>
I20260619 06:43:02.126255 28149 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:02.126399 28149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:02.126713 28149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:02.129902 28149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "d02c6856d4a646ecb38c6c01ce264256"
format_stamp: "Formatted at 2026-06-19 06:43:02 on dist-test-slave-7lz4"
server_key: "34a7e84ef6196606d28fcfb43c8d9666"
server_key_iv: "749e33d4e36bc41693a52b929c213761"
server_key_version: "encryptionkey@0"
I20260619 06:43:02.130681 28149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "d02c6856d4a646ecb38c6c01ce264256"
format_stamp: "Formatted at 2026-06-19 06:43:02 on dist-test-slave-7lz4"
server_key: "34a7e84ef6196606d28fcfb43c8d9666"
server_key_iv: "749e33d4e36bc41693a52b929c213761"
server_key_version: "encryptionkey@0"
I20260619 06:43:02.136305 28149 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 06:43:02.140065 28164 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:02.141552 28149 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:43:02.141759 28149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "d02c6856d4a646ecb38c6c01ce264256"
format_stamp: "Formatted at 2026-06-19 06:43:02 on dist-test-slave-7lz4"
server_key: "34a7e84ef6196606d28fcfb43c8d9666"
server_key_iv: "749e33d4e36bc41693a52b929c213761"
server_key_version: "encryptionkey@0"
I20260619 06:43:02.141983 28149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:02.156365 28149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:02.160540 28149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:02.160840 28149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:02.179783 28149 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:33377
I20260619 06:43:02.179842 28215 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:33377 every 8 connection(s)
I20260619 06:43:02.181277 28149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:02.184350 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 28149
I20260619 06:43:02.184581 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:02.185397 11009 external_mini_cluster.cc:1428] Setting key 1e8dc264dc334c2cf8a5e59e16a7bc4c
I20260619 06:43:02.185730 28216 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Jun 19 06:43:02 dist-test-slave-7lz4 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851381, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:43:02.202253 28216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256: Bootstrap starting.
I20260619 06:43:02.207195 28216 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:02.208395 28216 log.cc:824] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:02.211440 28216 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256: No bootstrap required, opened a new log
I20260619 06:43:02.212355 28219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:02.187545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52746 (local address 127.10.192.126:33377)
0619 06:43:02.188432 (+ 887us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:02.188448 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:02.188492 (+ 44us) server_negotiation.cc:407] Connection header received
0619 06:43:02.190632 (+ 2140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:02.190656 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:02.191095 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:02.191470 (+ 375us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:02.193376 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:02.194676 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:02.196733 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:02.197497 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:02.197649 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:02.204229 (+ 6580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:02.204252 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:02.204273 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:02.204325 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:02.207815 (+ 3490us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:02.208678 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:02.208685 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:02.208692 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:02.208872 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:02.209308 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:02.209311 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:02.209313 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:02.209902 (+ 589us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:02.210215 (+ 313us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:02.210690 (+ 475us) server_negotiation.cc:299] Negotiation successful
0619 06:43:02.211124 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":672,"thread_start_us":436,"threads_started":1}
I20260619 06:43:02.220135 28216 raft_consensus.cc:348] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d02c6856d4a646ecb38c6c01ce264256" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33377 } }
I20260619 06:43:02.220547 28216 raft_consensus.cc:374] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:02.220651 28216 raft_consensus.cc:729] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d02c6856d4a646ecb38c6c01ce264256, State: Initialized, Role: FOLLOWER
I20260619 06:43:02.221271 28216 consensus_queue.cc:260] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d02c6856d4a646ecb38c6c01ce264256" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33377 } }
I20260619 06:43:02.221522 28216 raft_consensus.cc:388] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:02.221663 28216 raft_consensus.cc:482] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:02.221843 28216 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:02.224442 28216 raft_consensus.cc:504] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d02c6856d4a646ecb38c6c01ce264256" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33377 } }
I20260619 06:43:02.224984 28216 leader_election.cc:302] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d02c6856d4a646ecb38c6c01ce264256; no voters:
I20260619 06:43:02.225615 28216 leader_election.cc:288] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:02.225755 28221 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:02.226451 28221 raft_consensus.cc:686] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256 [term 1 LEADER]: Becoming Leader. State: Replica: d02c6856d4a646ecb38c6c01ce264256, State: Running, Role: LEADER
I20260619 06:43:02.227005 28221 consensus_queue.cc:237] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d02c6856d4a646ecb38c6c01ce264256" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33377 } }
I20260619 06:43:02.227747 28216 sys_catalog.cc:564] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:02.230106 28222 sys_catalog.cc:455] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d02c6856d4a646ecb38c6c01ce264256" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d02c6856d4a646ecb38c6c01ce264256" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33377 } } }
I20260619 06:43:02.230695 28222 sys_catalog.cc:458] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:02.230093 28223 sys_catalog.cc:455] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d02c6856d4a646ecb38c6c01ce264256. Latest consensus state: current_term: 1 leader_uuid: "d02c6856d4a646ecb38c6c01ce264256" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d02c6856d4a646ecb38c6c01ce264256" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33377 } } }
I20260619 06:43:02.231107 28223 sys_catalog.cc:458] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:02.233367 28229 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:02.239055 28229 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:02.249691 28229 catalog_manager.cc:1347] Generated new cluster ID: c9bc5e23ab884d0eb4cad60f38cbb339
I20260619 06:43:02.249830 28229 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:02.261461 28229 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:02.262953 28229 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:02.270067 28229 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256: Generated new TSK 0
I20260619 06:43:02.270970 28229 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
I20260619 06:43:02.345034 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:33377
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:37967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:02.734966 28242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:02.735293 28242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:02.735458 28242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:02.743177 28242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:02.743341 28242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:02.743512 28242 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:43:02.753890 28242 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:37967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:33377
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:02.755295 28242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:02.756738 28242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:02.770038 28247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:02.770128 28250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:02.770073 28248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:02.771174 28242 server_base.cc:1034] running on GCE node
I20260619 06:43:02.771917 28242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:02.773064 28242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:02.774333 28242 hybrid_clock.cc:648] HybridClock initialized: now 1781851382774287 us; error 45 us; skew 500 ppm
I20260619 06:43:02.774614 28242 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:02 dist-test-slave-7lz4 krb5kdc[28136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851382, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:02.777699 28242 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:43:02.779224 28242 webserver.cc:460] Webserver started at http://127.10.192.65:36733/ using document root <none> and password file <none>
I20260619 06:43:02.779989 28242 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:02.780129 28242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:02.780440 28242 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:02.783463 28242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "aa1af667e0674256952e81ce6d716ef0"
format_stamp: "Formatted at 2026-06-19 06:43:02 on dist-test-slave-7lz4"
server_key: "915c1c6fee92df0ed1dcd5873a4de1f1"
server_key_iv: "e13b587689055184478c8d9d131a9eac"
server_key_version: "encryptionkey@0"
I20260619 06:43:02.784305 28242 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "aa1af667e0674256952e81ce6d716ef0"
format_stamp: "Formatted at 2026-06-19 06:43:02 on dist-test-slave-7lz4"
server_key: "915c1c6fee92df0ed1dcd5873a4de1f1"
server_key_iv: "e13b587689055184478c8d9d131a9eac"
server_key_version: "encryptionkey@0"
I20260619 06:43:02.789526 28242 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 06:43:02.793104 28257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:02.794448 28242 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:43:02.794624 28242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "aa1af667e0674256952e81ce6d716ef0"
format_stamp: "Formatted at 2026-06-19 06:43:02 on dist-test-slave-7lz4"
server_key: "915c1c6fee92df0ed1dcd5873a4de1f1"
server_key_iv: "e13b587689055184478c8d9d131a9eac"
server_key_version: "encryptionkey@0"
I20260619 06:43:02.794838 28242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:02.819060 28242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:02.823222 28242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:02.823518 28242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:02.824607 28242 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:43:02.825943 28242 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:43:02.826046 28242 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:02.826184 28242 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:43:02.826253 28242 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:02.861275 28242 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:36383
I20260619 06:43:02.861325 28369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:36383 every 8 connection(s)
I20260619 06:43:02.862619 28242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:43:02.865068 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 28242
I20260619 06:43:02.865276 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:43:02.865936 11009 external_mini_cluster.cc:1428] Setting key bb763645c4b8f524fbf6ffad1067cbdb
Jun 19 06:43:02 dist-test-slave-7lz4 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851382, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:43:02.884006 28372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:02.865182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:60681 (local address 127.10.192.126:33377)
0619 06:43:02.868112 (+ 2930us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:02.868118 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:02.868151 (+ 33us) server_negotiation.cc:407] Connection header received
0619 06:43:02.869284 (+ 1133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:02.869290 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:02.869383 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:02.869498 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:02.871049 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:02.871827 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:02.873345 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:02.873733 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:02.873859 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:02.878140 (+ 4281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:02.878147 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:02.878150 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:02.878183 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:02.880786 (+ 2603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:02.881564 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:02.881571 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:02.881584 (+ 13us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:02.881720 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:02.882157 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:02.882163 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:02.882166 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:02.882462 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:02.882616 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:02.883329 (+ 713us) server_negotiation.cc:299] Negotiation successful
0619 06:43:02.883597 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2787,"thread_start_us":2654,"threads_started":1}
I20260619 06:43:02.885052 28373 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:02.865939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33377 (local address 127.10.192.65:60681)
0619 06:43:02.866929 (+ 990us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:02.866989 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:02.869012 (+ 2023us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:02.869751 (+ 739us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:02.869760 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:02.870298 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:43:02.870877 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:02.870893 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:02.871965 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:02.871971 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:02.873203 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:02.873215 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:02.873963 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:02.873972 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:02.874202 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:02.874937 (+ 735us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:43:02.874976 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:43:02.877886 (+ 2910us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:43:02.880959 (+ 3073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:02.880969 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:02.880987 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:02.881440 (+ 453us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:02.881832 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:02.881837 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:02.881841 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:02.882048 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:02.882588 (+ 540us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:43:02.882597 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:43:02.882970 (+ 373us) client_negotiation.cc:769] Sending connection context
0619 06:43:02.883253 (+ 283us) client_negotiation.cc:240] Negotiation successful
0619 06:43:02.883850 (+ 597us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"thread_start_us":385,"threads_started":1}
I20260619 06:43:02.886616 28370 heartbeater.cc:347] Connected to a master server at 127.10.192.126:33377
I20260619 06:43:02.886941 28370 heartbeater.cc:464] Registering TS with master...
I20260619 06:43:02.887743 28370 heartbeater.cc:511] Master 127.10.192.126:33377 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.10.192.66@KRBTEST.COM; defaulting to no policy
I20260619 06:43:02.889955 28181 ts_manager.cc:194] Registered new tserver with Master: aa1af667e0674256952e81ce6d716ef0 (127.10.192.65:36383)
I20260619 06:43:02.891571 28181 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:60681
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
I20260619 06:43:02.920535 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:33377
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:37967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:03.260633 28376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:03.261003 28376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:03.261173 28376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:03.268639 28376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:03.268818 28376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:03.268999 28376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:43:03.279173 28376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:37967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:33377
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:03.280580 28376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:03.281955 28376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:03.295208 28381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:03.295246 28384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:03.295171 28382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:03.296147 28376 server_base.cc:1034] running on GCE node
I20260619 06:43:03.296849 28376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:03.297814 28376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:03.299033 28376 hybrid_clock.cc:648] HybridClock initialized: now 1781851383298948 us; error 76 us; skew 500 ppm
I20260619 06:43:03.299400 28376 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:03 dist-test-slave-7lz4 krb5kdc[28136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851383, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:03.302596 28376 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:43:03.304318 28376 webserver.cc:460] Webserver started at http://127.10.192.66:39595/ using document root <none> and password file <none>
I20260619 06:43:03.305086 28376 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:03.305248 28376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:03.305629 28376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:03.308807 28376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "719ef66c8e3844f8ae1e7cb75874a972"
format_stamp: "Formatted at 2026-06-19 06:43:03 on dist-test-slave-7lz4"
server_key: "750de04d7c18506118cb915a5d14ac74"
server_key_iv: "407bfc9ab3ee01a5d09f2f02935947f6"
server_key_version: "encryptionkey@0"
I20260619 06:43:03.309621 28376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "719ef66c8e3844f8ae1e7cb75874a972"
format_stamp: "Formatted at 2026-06-19 06:43:03 on dist-test-slave-7lz4"
server_key: "750de04d7c18506118cb915a5d14ac74"
server_key_iv: "407bfc9ab3ee01a5d09f2f02935947f6"
server_key_version: "encryptionkey@0"
I20260619 06:43:03.315562 28376 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260619 06:43:03.319384 28391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:03.320823 28376 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:43:03.320996 28376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "719ef66c8e3844f8ae1e7cb75874a972"
format_stamp: "Formatted at 2026-06-19 06:43:03 on dist-test-slave-7lz4"
server_key: "750de04d7c18506118cb915a5d14ac74"
server_key_iv: "407bfc9ab3ee01a5d09f2f02935947f6"
server_key_version: "encryptionkey@0"
I20260619 06:43:03.321193 28376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:03.338258 28376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:03.342320 28376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:03.342619 28376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:03.343683 28376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:43:03.345077 28376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:43:03.345180 28376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:03.345335 28376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:43:03.345386 28376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:03.379033 28376 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:38697
I20260619 06:43:03.379078 28503 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:38697 every 8 connection(s)
I20260619 06:43:03.380386 28376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:43:03.385250 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 28376
I20260619 06:43:03.385468 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:43:03.385984 11009 external_mini_cluster.cc:1428] Setting key 5f27ca6756327a4b32e1bb70773e865e
Jun 19 06:43:03 dist-test-slave-7lz4 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851383, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:43:03.402598 28372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:03.383193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:36153 (local address 127.10.192.126:33377)
0619 06:43:03.383418 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:03.383424 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:03.384756 (+ 1332us) server_negotiation.cc:407] Connection header received
0619 06:43:03.386847 (+ 2091us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:03.386853 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:03.386991 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:03.387100 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:03.389036 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.390221 (+ 1185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.391949 (+ 1728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.392682 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.392824 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:03.396775 (+ 3951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:03.396781 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:03.396784 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:03.396819 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:03.399458 (+ 2639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:03.400247 (+ 789us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:03.400251 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:03.400254 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:03.400392 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:03.400844 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:03.400848 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:03.400850 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:03.401130 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:03.401283 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:03.401989 (+ 706us) server_negotiation.cc:299] Negotiation successful
0619 06:43:03.402227 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260619 06:43:03.403613 28506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:03.383815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33377 (local address 127.10.192.66:36153)
0619 06:43:03.384587 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:03.384627 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:03.386520 (+ 1893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:03.387395 (+ 875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:03.387406 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:03.388240 (+ 834us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:43:03.388858 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:03.388876 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.390401 (+ 1525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.390404 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:03.391774 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:03.391787 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.392935 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.392940 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:03.393147 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:03.393890 (+ 743us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:43:03.393913 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:43:03.396508 (+ 2595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:43:03.399609 (+ 3101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:03.399618 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:03.399658 (+ 40us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:03.400110 (+ 452us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:03.400513 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:03.400518 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:03.400521 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:03.400720 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:03.401258 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:43:03.401266 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:43:03.401631 (+ 365us) client_negotiation.cc:769] Sending connection context
0619 06:43:03.401903 (+ 272us) client_negotiation.cc:240] Negotiation successful
0619 06:43:03.402459 (+ 556us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":282,"threads_started":1}
I20260619 06:43:03.405241 28504 heartbeater.cc:347] Connected to a master server at 127.10.192.126:33377
I20260619 06:43:03.405591 28504 heartbeater.cc:464] Registering TS with master...
I20260619 06:43:03.406526 28504 heartbeater.cc:511] Master 127.10.192.126:33377 requested a full tablet report, sending...
I20260619 06:43:03.408264 28181 ts_manager.cc:194] Registered new tserver with Master: 719ef66c8e3844f8ae1e7cb75874a972 (127.10.192.66:38697)
I20260619 06:43:03.409107 28181 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:36153
WARNING: no policy specified for kudu/127.10.192.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
I20260619 06:43:03.442530 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:33377
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:37967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:03.774509 28509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:03.774784 28509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:03.775017 28509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:03.782518 28509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:03.782640 28509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:03.782755 28509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:43:03.792618 28509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:37967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:33377
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:03.793883 28509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:03.795198 28509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:03.808501 28515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:03.808578 28514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:03.808574 28517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:03.810073 28509 server_base.cc:1034] running on GCE node
I20260619 06:43:03.810669 28509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:03.811578 28509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:03.812829 28509 hybrid_clock.cc:648] HybridClock initialized: now 1781851383812777 us; error 46 us; skew 500 ppm
I20260619 06:43:03.813167 28509 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:03 dist-test-slave-7lz4 krb5kdc[28136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851383, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:03.816569 28509 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:43:03.818045 28509 webserver.cc:460] Webserver started at http://127.10.192.67:41157/ using document root <none> and password file <none>
I20260619 06:43:03.818737 28509 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:03.818858 28509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:03.819207 28509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:03.822145 28509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "d6f29431d2f64c938c14033e4d743aa3"
format_stamp: "Formatted at 2026-06-19 06:43:03 on dist-test-slave-7lz4"
server_key: "d3696333537bec786351d025bfe8f8fb"
server_key_iv: "80235ca486f958d51278bda78bdcd4dc"
server_key_version: "encryptionkey@0"
I20260619 06:43:03.822911 28509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "d6f29431d2f64c938c14033e4d743aa3"
format_stamp: "Formatted at 2026-06-19 06:43:03 on dist-test-slave-7lz4"
server_key: "d3696333537bec786351d025bfe8f8fb"
server_key_iv: "80235ca486f958d51278bda78bdcd4dc"
server_key_version: "encryptionkey@0"
I20260619 06:43:03.828439 28509 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260619 06:43:03.831945 28524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:03.833343 28509 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260619 06:43:03.833549 28509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "d6f29431d2f64c938c14033e4d743aa3"
format_stamp: "Formatted at 2026-06-19 06:43:03 on dist-test-slave-7lz4"
server_key: "d3696333537bec786351d025bfe8f8fb"
server_key_iv: "80235ca486f958d51278bda78bdcd4dc"
server_key_version: "encryptionkey@0"
I20260619 06:43:03.833751 28509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:03.870050 28509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:03.874577 28509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:03.874884 28509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:03.875902 28509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:43:03.877295 28509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:43:03.877404 28509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:03.877557 28509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:43:03.877627 28509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:03.894785 28370 heartbeater.cc:503] Master 127.10.192.126:33377 was elected leader, sending a full tablet report...
I20260619 06:43:03.911405 28509 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:36117
I20260619 06:43:03.911468 28636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:36117 every 8 connection(s)
I20260619 06:43:03.912892 28509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:43:03.917129 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 28509
I20260619 06:43:03.917318 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:43:03.917822 11009 external_mini_cluster.cc:1428] Setting key f94349197951c652497bfa0f95c2d2d1
Jun 19 06:43:03 dist-test-slave-7lz4 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851383, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:43:03.933964 28639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:03.915489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:41375 (local address 127.10.192.126:33377)
0619 06:43:03.916021 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:03.916025 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:03.917030 (+ 1005us) server_negotiation.cc:407] Connection header received
0619 06:43:03.919200 (+ 2170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:03.919207 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:03.919294 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:03.919430 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:03.921390 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.922250 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.923829 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.924238 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.924330 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:03.927814 (+ 3484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:03.927819 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:03.927822 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:03.927856 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:03.930557 (+ 2701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:03.931293 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:03.931297 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:03.931299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:03.931460 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:03.932006 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:03.932011 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:03.932013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:03.932362 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:03.932487 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:03.933442 (+ 955us) server_negotiation.cc:299] Negotiation successful
0619 06:43:03.933652 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":292,"threads_started":1}
I20260619 06:43:03.935057 28640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:03.916180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:33377 (local address 127.10.192.67:41375)
0619 06:43:03.916865 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:03.916919 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:03.918863 (+ 1944us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:03.919761 (+ 898us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:03.919770 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:03.920547 (+ 777us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:43:03.921241 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:03.921258 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.922401 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.922404 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:03.923704 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:03.923716 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.924420 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.924425 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:03.924613 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:03.925342 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:43:03.925365 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:43:03.927569 (+ 2204us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:43:03.930688 (+ 3119us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:03.930695 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:03.930707 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:03.931182 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:03.931569 (+ 387us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:03.931573 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:03.931575 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:03.931881 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:03.932510 (+ 629us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:43:03.932519 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:43:03.932978 (+ 459us) client_negotiation.cc:769] Sending connection context
0619 06:43:03.933321 (+ 343us) client_negotiation.cc:240] Negotiation successful
0619 06:43:03.933825 (+ 504us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":280,"threads_started":1}
I20260619 06:43:03.936434 28637 heartbeater.cc:347] Connected to a master server at 127.10.192.126:33377
I20260619 06:43:03.936728 28637 heartbeater.cc:464] Registering TS with master...
I20260619 06:43:03.937445 28637 heartbeater.cc:511] Master 127.10.192.126:33377 requested a full tablet report, sending...
I20260619 06:43:03.938897 28181 ts_manager.cc:194] Registered new tserver with Master: d6f29431d2f64c938c14033e4d743aa3 (127.10.192.67:36117)
I20260619 06:43:03.939721 28181 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:41375
I20260619 06:43:03.945480 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 06:43:03.962579 28639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:03.950011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52758 (local address 127.10.192.126:33377)
0619 06:43:03.950164 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:03.950169 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:03.950662 (+ 493us) server_negotiation.cc:407] Connection header received
0619 06:43:03.950813 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:03.950817 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:03.950912 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:03.950989 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:03.952416 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.953088 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.954507 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.954922 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.955011 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:03.957463 (+ 2452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:03.957468 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:03.957471 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:03.957504 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:03.960150 (+ 2646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:03.960724 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:03.960727 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:03.960729 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:03.960875 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:03.961218 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:03.961222 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:03.961225 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:03.961619 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:03.961823 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:03.962142 (+ 319us) server_negotiation.cc:299] Negotiation successful
0619 06:43:03.962327 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260619 06:43:03.966727 28181 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52758:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:43:03.973683 28181 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:43:03.997704 28652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:03.986398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:36383 (local address 127.0.0.1:33696)
0619 06:43:03.987701 (+ 1303us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:03.987750 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:03.987933 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:03.989498 (+ 1565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:03.989505 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:03.989540 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:03.989953 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:03.989972 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.992387 (+ 2415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.992392 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:03.994964 (+ 2572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:03.994979 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.996561 (+ 1582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.996567 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:03.996797 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:03.996858 (+ 61us) client_negotiation.cc:769] Sending connection context
0619 06:43:03.996990 (+ 132us) client_negotiation.cc:240] Negotiation successful
0619 06:43:03.997197 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":975,"mutex_wait_us":21,"thread_start_us":2342,"threads_started":1}
I20260619 06:43:03.998646 28650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:03.986581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:38697 (local address 127.0.0.1:57688)
0619 06:43:03.989079 (+ 2498us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:03.989097 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:03.989237 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:03.991062 (+ 1825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:03.991066 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:03.991087 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:03.991518 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:03.991531 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.993410 (+ 1879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.993415 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:03.995507 (+ 2092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:03.995517 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.997722 (+ 2205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.997730 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:03.997942 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:03.997976 (+ 34us) client_negotiation.cc:769] Sending connection context
0619 06:43:03.998058 (+ 82us) client_negotiation.cc:240] Negotiation successful
0619 06:43:03.998198 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2364,"mutex_wait_us":35,"thread_start_us":898,"threads_started":1}
I20260619 06:43:03.998869 28651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:03.986565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33696 (local address 127.10.192.65:36383)
0619 06:43:03.988686 (+ 2121us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:03.988699 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:03.988748 (+ 49us) server_negotiation.cc:407] Connection header received
0619 06:43:03.988882 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:03.988893 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:03.989233 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:03.989472 (+ 239us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:03.990198 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.992219 (+ 2021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.995137 (+ 2918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.996352 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.996501 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:03.996748 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:03.997037 (+ 289us) server_negotiation.cc:299] Negotiation successful
0619 06:43:03.997208 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1896,"thread_start_us":1765,"threads_started":1}
I20260619 06:43:03.999490 28653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:03.987153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57688 (local address 127.10.192.66:38697)
0619 06:43:03.990242 (+ 3089us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:03.990248 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:03.990270 (+ 22us) server_negotiation.cc:407] Connection header received
0619 06:43:03.990353 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:03.990358 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:03.990604 (+ 246us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:03.990809 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:03.991748 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.993238 (+ 1490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.995674 (+ 2436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.997224 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.997374 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:03.997569 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:03.998953 (+ 1384us) server_negotiation.cc:299] Negotiation successful
0619 06:43:03.999148 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2940,"thread_start_us":2813,"threads_started":1}
I20260619 06:43:04.000967 28655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:03.990281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:36117 (local address 127.0.0.1:50824)
0619 06:43:03.990804 (+ 523us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:03.990822 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:03.990924 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:03.993382 (+ 2458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:03.993387 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:03.993413 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:03.993918 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:03.993931 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.995836 (+ 1905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.995840 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:03.997958 (+ 2118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:03.997971 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:04.000178 (+ 2207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:04.000184 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:04.000356 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:04.000386 (+ 30us) client_negotiation.cc:769] Sending connection context
0619 06:43:04.000491 (+ 105us) client_negotiation.cc:240] Negotiation successful
0619 06:43:04.000628 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"thread_start_us":408,"threads_started":1}
I20260619 06:43:04.001078 28654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:03.989546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50824 (local address 127.10.192.67:36117)
0619 06:43:03.992860 (+ 3314us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:03.992866 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:03.992889 (+ 23us) server_negotiation.cc:407] Connection header received
0619 06:43:03.992956 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:03.992961 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:03.993116 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:03.993302 (+ 186us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:03.994129 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.995692 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.998136 (+ 2444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:03.999695 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:03.999835 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:04.000050 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:04.000553 (+ 503us) server_negotiation.cc:299] Negotiation successful
0619 06:43:04.000732 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3157,"thread_start_us":3012,"threads_started":1}
I20260619 06:43:04.002833 28305 tablet_service.cc:1467] Processing CreateTablet for tablet 52680f6aac514d53afad772c640a4afd (DEFAULT_TABLE table=test-table [id=fc8a323e61a549bca2305ad2f2c94e47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:43:04.003285 28439 tablet_service.cc:1467] Processing CreateTablet for tablet 52680f6aac514d53afad772c640a4afd (DEFAULT_TABLE table=test-table [id=fc8a323e61a549bca2305ad2f2c94e47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:43:04.004189 28305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52680f6aac514d53afad772c640a4afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:04.004698 28439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52680f6aac514d53afad772c640a4afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:04.005414 28572 tablet_service.cc:1467] Processing CreateTablet for tablet 52680f6aac514d53afad772c640a4afd (DEFAULT_TABLE table=test-table [id=fc8a323e61a549bca2305ad2f2c94e47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:43:04.006897 28572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52680f6aac514d53afad772c640a4afd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:04.015592 28656 tablet_bootstrap.cc:492] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0: Bootstrap starting.
I20260619 06:43:04.019253 28656 tablet_bootstrap.cc:654] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:04.020480 28656 log.cc:824] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:04.025540 28657 tablet_bootstrap.cc:492] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972: Bootstrap starting.
I20260619 06:43:04.025591 28659 tablet_bootstrap.cc:492] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3: Bootstrap starting.
I20260619 06:43:04.027593 28656 tablet_bootstrap.cc:492] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0: No bootstrap required, opened a new log
I20260619 06:43:04.027953 28656 ts_tablet_manager.cc:1397] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.006s
I20260619 06:43:04.029474 28659 tablet_bootstrap.cc:654] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:04.029757 28657 tablet_bootstrap.cc:654] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:04.030766 28659 log.cc:824] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:04.030807 28657 log.cc:824] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:04.037045 28657 tablet_bootstrap.cc:492] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972: No bootstrap required, opened a new log
I20260619 06:43:04.037376 28657 ts_tablet_manager.cc:1397] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.003s
I20260619 06:43:04.037735 28659 tablet_bootstrap.cc:492] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3: No bootstrap required, opened a new log
I20260619 06:43:04.037998 28659 ts_tablet_manager.cc:1397] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.004s
I20260619 06:43:04.039664 28656 raft_consensus.cc:348] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1af667e0674256952e81ce6d716ef0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 36383 } } peers { permanent_uuid: "719ef66c8e3844f8ae1e7cb75874a972" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38697 } } peers { permanent_uuid: "d6f29431d2f64c938c14033e4d743aa3" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36117 } }
I20260619 06:43:04.040292 28656 raft_consensus.cc:374] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:04.040441 28656 raft_consensus.cc:729] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa1af667e0674256952e81ce6d716ef0, State: Initialized, Role: FOLLOWER
I20260619 06:43:04.041263 28656 consensus_queue.cc:260] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1af667e0674256952e81ce6d716ef0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 36383 } } peers { permanent_uuid: "719ef66c8e3844f8ae1e7cb75874a972" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38697 } } peers { permanent_uuid: "d6f29431d2f64c938c14033e4d743aa3" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36117 } }
I20260619 06:43:04.043133 28656 ts_tablet_manager.cc:1428] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0: Time spent starting tablet: real 0.015s user 0.009s sys 0.005s
I20260619 06:43:04.046351 28657 raft_consensus.cc:348] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1af667e0674256952e81ce6d716ef0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 36383 } } peers { permanent_uuid: "719ef66c8e3844f8ae1e7cb75874a972" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38697 } } peers { permanent_uuid: "d6f29431d2f64c938c14033e4d743aa3" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36117 } }
I20260619 06:43:04.046890 28657 raft_consensus.cc:374] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:04.047006 28657 raft_consensus.cc:729] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 719ef66c8e3844f8ae1e7cb75874a972, State: Initialized, Role: FOLLOWER
I20260619 06:43:04.047701 28657 consensus_queue.cc:260] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1af667e0674256952e81ce6d716ef0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 36383 } } peers { permanent_uuid: "719ef66c8e3844f8ae1e7cb75874a972" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38697 } } peers { permanent_uuid: "d6f29431d2f64c938c14033e4d743aa3" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36117 } }
I20260619 06:43:04.048363 28659 raft_consensus.cc:348] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1af667e0674256952e81ce6d716ef0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 36383 } } peers { permanent_uuid: "719ef66c8e3844f8ae1e7cb75874a972" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38697 } } peers { permanent_uuid: "d6f29431d2f64c938c14033e4d743aa3" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36117 } }
I20260619 06:43:04.048859 28659 raft_consensus.cc:374] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:04.048936 28504 heartbeater.cc:503] Master 127.10.192.126:33377 was elected leader, sending a full tablet report...
I20260619 06:43:04.048982 28659 raft_consensus.cc:729] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6f29431d2f64c938c14033e4d743aa3, State: Initialized, Role: FOLLOWER
I20260619 06:43:04.049544 28659 consensus_queue.cc:260] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1af667e0674256952e81ce6d716ef0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 36383 } } peers { permanent_uuid: "719ef66c8e3844f8ae1e7cb75874a972" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38697 } } peers { permanent_uuid: "d6f29431d2f64c938c14033e4d743aa3" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36117 } }
I20260619 06:43:04.049713 28657 ts_tablet_manager.cc:1428] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972: Time spent starting tablet: real 0.012s user 0.009s sys 0.004s
I20260619 06:43:04.050523 28637 heartbeater.cc:503] Master 127.10.192.126:33377 was elected leader, sending a full tablet report...
I20260619 06:43:04.051154 28659 ts_tablet_manager.cc:1428] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3: Time spent starting tablet: real 0.013s user 0.014s sys 0.000s
I20260619 06:43:04.090997 28664 raft_consensus.cc:482] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:43:04.091277 28664 raft_consensus.cc:504] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1af667e0674256952e81ce6d716ef0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 36383 } } peers { permanent_uuid: "719ef66c8e3844f8ae1e7cb75874a972" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38697 } } peers { permanent_uuid: "d6f29431d2f64c938c14033e4d743aa3" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36117 } }
I20260619 06:43:04.093122 28664 leader_election.cc:288] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa1af667e0674256952e81ce6d716ef0 (127.10.192.65:36383), 719ef66c8e3844f8ae1e7cb75874a972 (127.10.192.66:38697)
I20260619 06:43:04.100549 28640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:04.093442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:38697 (local address 127.10.192.67:54721)
0619 06:43:04.093677 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:04.093699 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:04.093839 (+ 140us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:04.094310 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:04.094317 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:04.094351 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:04.094582 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:04.094597 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:04.095998 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:04.096002 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:04.098140 (+ 2138us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:04.098160 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:04.099781 (+ 1621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:04.099788 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:04.099983 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:04.100017 (+ 34us) client_negotiation.cc:769] Sending connection context
0619 06:43:04.100112 (+ 95us) client_negotiation.cc:240] Negotiation successful
0619 06:43:04.100254 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260619 06:43:04.100746 28653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:04.093633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:54721 (local address 127.10.192.66:38697)
0619 06:43:04.093844 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:04.093851 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:04.093947 (+ 96us) server_negotiation.cc:407] Connection header received
0619 06:43:04.094050 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:04.094058 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:04.094160 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:04.094261 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:04.094739 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:04.095827 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:04.098295 (+ 2468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:04.099567 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:04.099788 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:04.099868 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:04.100347 (+ 479us) server_negotiation.cc:299] Negotiation successful
0619 06:43:04.100487 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 06:43:04.100976 28651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:04.093694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:43545 (local address 127.10.192.65:36383)
0619 06:43:04.093969 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:04.093978 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:04.094535 (+ 557us) server_negotiation.cc:407] Connection header received
0619 06:43:04.094678 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:04.094685 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:04.094761 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:04.094867 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:04.095332 (+ 465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:04.096249 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:04.098618 (+ 2369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:04.100006 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:04.100186 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:04.100253 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:04.100591 (+ 338us) server_negotiation.cc:299] Negotiation successful
0619 06:43:04.100718 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260619 06:43:04.101614 28665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:04.093442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:36383 (local address 127.10.192.67:43545)
0619 06:43:04.094409 (+ 967us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:04.094426 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:04.094547 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:04.094891 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:04.094894 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:04.094913 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:04.095183 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:04.095190 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:04.096402 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:04.096407 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:04.098479 (+ 2072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:04.098489 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:04.100205 (+ 1716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:04.100212 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:04.100399 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:04.100434 (+ 35us) client_negotiation.cc:769] Sending connection context
0619 06:43:04.101106 (+ 672us) client_negotiation.cc:240] Negotiation successful
0619 06:43:04.101251 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":835,"mutex_wait_us":332,"thread_start_us":326,"threads_started":1}
I20260619 06:43:04.101975 28459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52680f6aac514d53afad772c640a4afd" candidate_uuid: "d6f29431d2f64c938c14033e4d743aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719ef66c8e3844f8ae1e7cb75874a972" is_pre_election: true
I20260619 06:43:04.102530 28459 raft_consensus.cc:2454] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6f29431d2f64c938c14033e4d743aa3 in term 0.
I20260619 06:43:04.102731 28325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52680f6aac514d53afad772c640a4afd" candidate_uuid: "d6f29431d2f64c938c14033e4d743aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa1af667e0674256952e81ce6d716ef0" is_pre_election: true
I20260619 06:43:04.103255 28527 leader_election.cc:302] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 719ef66c8e3844f8ae1e7cb75874a972, d6f29431d2f64c938c14033e4d743aa3; no voters:
I20260619 06:43:04.103307 28325 raft_consensus.cc:2454] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d6f29431d2f64c938c14033e4d743aa3 in term 0.
I20260619 06:43:04.103657 28664 raft_consensus.cc:2781] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:43:04.103819 28664 raft_consensus.cc:482] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:43:04.103906 28664 raft_consensus.cc:3037] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:04.106208 28664 raft_consensus.cc:504] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1af667e0674256952e81ce6d716ef0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 36383 } } peers { permanent_uuid: "719ef66c8e3844f8ae1e7cb75874a972" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38697 } } peers { permanent_uuid: "d6f29431d2f64c938c14033e4d743aa3" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36117 } }
I20260619 06:43:04.106786 28664 leader_election.cc:288] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [CANDIDATE]: Term 1 election: Requested vote from peers aa1af667e0674256952e81ce6d716ef0 (127.10.192.65:36383), 719ef66c8e3844f8ae1e7cb75874a972 (127.10.192.66:38697)
I20260619 06:43:04.107299 28459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52680f6aac514d53afad772c640a4afd" candidate_uuid: "d6f29431d2f64c938c14033e4d743aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "719ef66c8e3844f8ae1e7cb75874a972"
I20260619 06:43:04.107332 28325 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52680f6aac514d53afad772c640a4afd" candidate_uuid: "d6f29431d2f64c938c14033e4d743aa3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa1af667e0674256952e81ce6d716ef0"
I20260619 06:43:04.107494 28459 raft_consensus.cc:3037] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:04.107590 28325 raft_consensus.cc:3037] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:04.109768 28459 raft_consensus.cc:2454] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6f29431d2f64c938c14033e4d743aa3 in term 1.
I20260619 06:43:04.109843 28325 raft_consensus.cc:2454] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d6f29431d2f64c938c14033e4d743aa3 in term 1.
I20260619 06:43:04.110226 28527 leader_election.cc:302] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 719ef66c8e3844f8ae1e7cb75874a972, d6f29431d2f64c938c14033e4d743aa3; no voters:
I20260619 06:43:04.110513 28664 raft_consensus.cc:2781] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:04.110962 28664 raft_consensus.cc:686] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [term 1 LEADER]: Becoming Leader. State: Replica: d6f29431d2f64c938c14033e4d743aa3, State: Running, Role: LEADER
I20260619 06:43:04.111466 28664 consensus_queue.cc:237] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1af667e0674256952e81ce6d716ef0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 36383 } } peers { permanent_uuid: "719ef66c8e3844f8ae1e7cb75874a972" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38697 } } peers { permanent_uuid: "d6f29431d2f64c938c14033e4d743aa3" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36117 } }
W20260619 06:43:04.115141 28371 tablet.cc:2369] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:43:04.116346 28181 catalog_manager.cc:5495] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d6f29431d2f64c938c14033e4d743aa3 (127.10.192.67). New cstate: current_term: 1 leader_uuid: "d6f29431d2f64c938c14033e4d743aa3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa1af667e0674256952e81ce6d716ef0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "719ef66c8e3844f8ae1e7cb75874a972" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d6f29431d2f64c938c14033e4d743aa3" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 36117 } health_report { overall_health: HEALTHY } } }
W20260619 06:43:04.132614 28505 tablet.cc:2369] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:43:04.137677 28654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:04.132008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50828 (local address 127.10.192.67:36117)
0619 06:43:04.132187 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:04.132191 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:04.132423 (+ 232us) server_negotiation.cc:407] Connection header received
0619 06:43:04.132638 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:04.132641 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:04.132732 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:04.132922 (+ 190us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:43:04.133328 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:04.134053 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:04.135476 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:04.135949 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:04.136085 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:04.136558 (+ 473us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:43:04.137105 (+ 547us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:43:04.137256 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:04.137314 (+ 58us) server_negotiation.cc:299] Negotiation successful
0619 06:43:04.137403 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260619 06:43:04.146032 28459 raft_consensus.cc:1261] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972 [term 1 FOLLOWER]: Refusing update from remote peer d6f29431d2f64c938c14033e4d743aa3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:43:04.146073 28325 raft_consensus.cc:1261] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0 [term 1 FOLLOWER]: Refusing update from remote peer d6f29431d2f64c938c14033e4d743aa3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:43:04.147110 28666 consensus_queue.cc:1035] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "719ef66c8e3844f8ae1e7cb75874a972" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 38697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:43:04.147607 28664 consensus_queue.cc:1035] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa1af667e0674256952e81ce6d716ef0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:43:04.161751 28669 mvcc.cc:205] Tried to move back new op lower bound from 7298463269451493376 to 7298463269325213696. Current Snapshot: MvccSnapshot[applied={T|T < 7298463269451493376}]
I20260619 06:43:04.167133 28670 mvcc.cc:205] Tried to move back new op lower bound from 7298463269451493376 to 7298463269325213696. Current Snapshot: MvccSnapshot[applied={T|T < 7298463269451493376}]
I20260619 06:43:04.178135 28181 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52758:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:43:04.178581 28181 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52758:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:43:04.183090 28181 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d02c6856d4a646ecb38c6c01ce264256: Sending DeleteTablet for 3 replicas of tablet 52680f6aac514d53afad772c640a4afd
I20260619 06:43:04.184337 28671 mvcc.cc:205] Tried to move back new op lower bound from 7298463269451493376 to 7298463269325213696. Current Snapshot: MvccSnapshot[applied={T|T < 7298463269451493376}]
I20260619 06:43:04.184396 28305 tablet_service.cc:1514] Processing DeleteTablet for tablet 52680f6aac514d53afad772c640a4afd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:43:04 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:33696
I20260619 06:43:04.189572 28439 tablet_service.cc:1514] Processing DeleteTablet for tablet 52680f6aac514d53afad772c640a4afd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:43:04 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:57688
I20260619 06:43:04.195043 28679 tablet_replica.cc:330] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0: stopping tablet replica
I20260619 06:43:04.198275 28572 tablet_service.cc:1514] Processing DeleteTablet for tablet 52680f6aac514d53afad772c640a4afd with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:43:04 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:50824
I20260619 06:43:04.198992 28679 raft_consensus.cc:2229] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:43:04.199668 28679 raft_consensus.cc:2258] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:43:04.200915 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 28242
I20260619 06:43:04.203513 28681 tablet_replica.cc:330] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3: stopping tablet replica
I20260619 06:43:04.210126 28681 raft_consensus.cc:2229] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:43:04.210548 28679 ts_tablet_manager.cc:1905] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:43:04.211609 28681 raft_consensus.cc:2258] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:43:04.222419 28681 ts_tablet_manager.cc:1905] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:43:04.225112 28679 ts_tablet_manager.cc:1918] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:43:04.225243 28679 log.cc:1196] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/52680f6aac514d53afad772c640a4afd
I20260619 06:43:04.225695 28679 ts_tablet_manager.cc:1939] T 52680f6aac514d53afad772c640a4afd P aa1af667e0674256952e81ce6d716ef0: Deleting consensus metadata
I20260619 06:43:04.227250 28165 catalog_manager.cc:4841] TS aa1af667e0674256952e81ce6d716ef0 (127.10.192.65:36383): tablet 52680f6aac514d53afad772c640a4afd (table test-table [id=fc8a323e61a549bca2305ad2f2c94e47]) successfully deleted
Jun 19 06:43:04 dist-test-slave-7lz4 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851381, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:43:04.236526 28681 ts_tablet_manager.cc:1918] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:43:04.236914 28681 log.cc:1196] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/52680f6aac514d53afad772c640a4afd
I20260619 06:43:04.237694 28681 ts_tablet_manager.cc:1939] T 52680f6aac514d53afad772c640a4afd P d6f29431d2f64c938c14033e4d743aa3: Deleting consensus metadata
I20260619 06:43:04.242899 28651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:04.203575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33704 (local address 127.10.192.65:36383)
0619 06:43:04.203779 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:04.203785 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:04.219002 (+ 15217us) server_negotiation.cc:407] Connection header received
0619 06:43:04.220416 (+ 1414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:04.220422 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:04.220516 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:04.220590 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:04.227129 (+ 6539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:04.228179 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:04.229592 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:04.230100 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:04.230232 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:04.234575 (+ 4343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:04.234595 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:04.234617 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:04.234654 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:04.238872 (+ 4218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:04.239891 (+ 1019us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:04.239904 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:04.239908 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:04.240082 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:04.240574 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:04.240579 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:04.240582 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:04.241101 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:04.241398 (+ 297us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:04.242120 (+ 722us) server_negotiation.cc:299] Negotiation successful
0619 06:43:04.242411 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260619 06:43:04.243937 28165 catalog_manager.cc:4841] TS d6f29431d2f64c938c14033e4d743aa3 (127.10.192.67:36117): tablet 52680f6aac514d53afad772c640a4afd (table test-table [id=fc8a323e61a549bca2305ad2f2c94e47]) successfully deleted
I20260619 06:43:04.244458 28680 tablet_replica.cc:330] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972: stopping tablet replica
I20260619 06:43:04.244966 28680 raft_consensus.cc:2229] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:43:04.245114 28365 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:04.245484 28680 raft_consensus.cc:2258] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:43:04.249601 28680 ts_tablet_manager.cc:1905] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:43:04.255093 28680 ts_tablet_manager.cc:1918] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:43:04.255268 28680 log.cc:1196] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/52680f6aac514d53afad772c640a4afd
I20260619 06:43:04.255848 28680 ts_tablet_manager.cc:1939] T 52680f6aac514d53afad772c640a4afd P 719ef66c8e3844f8ae1e7cb75874a972: Deleting consensus metadata
I20260619 06:43:04.257994 28167 catalog_manager.cc:4841] TS 719ef66c8e3844f8ae1e7cb75874a972 (127.10.192.66:38697): tablet 52680f6aac514d53afad772c640a4afd (table test-table [id=fc8a323e61a549bca2305ad2f2c94e47]) successfully deleted
I20260619 06:43:04.347506 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 28242
I20260619 06:43:04.372394 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 28376
Jun 19 06:43:04 dist-test-slave-7lz4 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851381, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.66@KRBTEST.COM
I20260619 06:43:04.392241 28653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:04.373291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57702 (local address 127.10.192.66:38697)
0619 06:43:04.373460 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:04.373464 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:04.373482 (+ 18us) server_negotiation.cc:407] Connection header received
0619 06:43:04.373619 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:04.373623 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:04.373697 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:04.373774 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:04.375518 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:04.376369 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:04.378340 (+ 1971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:04.379005 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:04.379128 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:04.384574 (+ 5446us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:04.384589 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:04.384606 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:04.384657 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:04.389021 (+ 4364us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:04.389837 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:04.389848 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:04.389852 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:04.390008 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:04.390404 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:04.390410 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:04.390413 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:04.390948 (+ 535us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:04.391240 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:04.391554 (+ 314us) server_negotiation.cc:299] Negotiation successful
0619 06:43:04.391809 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260619 06:43:04.393002 28499 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:04.486069 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 28376
I20260619 06:43:04.506664 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 28509
Jun 19 06:43:04 dist-test-slave-7lz4 krb5kdc[28136](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851381, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.67@KRBTEST.COM
I20260619 06:43:04.523962 28654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:04.507579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32998 (local address 127.10.192.67:36117)
0619 06:43:04.507804 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:04.507818 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:04.507845 (+ 27us) server_negotiation.cc:407] Connection header received
0619 06:43:04.508029 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:04.508034 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:04.508125 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:04.508804 (+ 679us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:04.509970 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:04.510805 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:04.512351 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:04.512827 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:04.512997 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:04.517499 (+ 4502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:04.517520 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:04.517536 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:04.517580 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:04.521020 (+ 3440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:04.521759 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:04.521766 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:04.521768 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:04.521931 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:04.522295 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:04.522305 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:04.522307 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:04.522663 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:04.522978 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:04.523313 (+ 335us) server_negotiation.cc:299] Negotiation successful
0619 06:43:04.523542 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260619 06:43:04.524772 28632 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:04.647076 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 28509
I20260619 06:43:04.662432 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 28149
I20260619 06:43:04.663619 28211 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:04.780462 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 28149
2026-06-19T06:43:04Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (4416 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-06-19T06:43:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:04Z Disabled control of system clock
I20260619 06:43:04.858793 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:38719
--webserver_interface=127.10.192.126
--webserver_port=0
--builtin_ntp_servers=127.10.192.84:35207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:38719
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260619 06:43:05.191331 28690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:05.191687 28690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:05.191846 28690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:05.199366 28690 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:05.199487 28690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:05.199564 28690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:05.199685 28690 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:05.199740 28690 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:05.209125 28690 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:35207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:38719
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:38719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:05.210602 28690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:05.212483 28690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:05.224511 28695 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:05.224478 28698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:05.224431 28696 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:05.225253 28690 server_base.cc:1034] running on GCE node
I20260619 06:43:05.226038 28690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:05.227665 28690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:05.228917 28690 hybrid_clock.cc:648] HybridClock initialized: now 1781851385228851 us; error 53 us; skew 500 ppm
I20260619 06:43:05.229280 28690 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:43:05.238602 28690 webserver.cc:460] Webserver started at http://127.10.192.126:44601/ using document root <none> and password file <none>
I20260619 06:43:05.239403 28690 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:05.239540 28690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:05.239936 28690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:05.243054 28690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "f39d06acd8944ca780594c49d38de551"
format_stamp: "Formatted at 2026-06-19 06:43:05 on dist-test-slave-7lz4"
server_key: "c8317d41190bf5768cb3bca3690162cf"
server_key_iv: "f7d57113795a60c97ce81e179ee49ea7"
server_key_version: "encryptionkey@0"
I20260619 06:43:05.244001 28690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "f39d06acd8944ca780594c49d38de551"
format_stamp: "Formatted at 2026-06-19 06:43:05 on dist-test-slave-7lz4"
server_key: "c8317d41190bf5768cb3bca3690162cf"
server_key_iv: "f7d57113795a60c97ce81e179ee49ea7"
server_key_version: "encryptionkey@0"
I20260619 06:43:05.249306 28690 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 06:43:05.252784 28704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:05.254112 28690 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:43:05.254297 28690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "f39d06acd8944ca780594c49d38de551"
format_stamp: "Formatted at 2026-06-19 06:43:05 on dist-test-slave-7lz4"
server_key: "c8317d41190bf5768cb3bca3690162cf"
server_key_iv: "f7d57113795a60c97ce81e179ee49ea7"
server_key_version: "encryptionkey@0"
I20260619 06:43:05.254520 28690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:05.266882 28690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:05.267810 28690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:05.268136 28690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:05.287041 28690 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:38719
I20260619 06:43:05.287060 28755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:38719 every 8 connection(s)
I20260619 06:43:05.288476 28690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:05.292444 28756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:05.294663 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 28690
I20260619 06:43:05.294843 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:05.295387 11009 external_mini_cluster.cc:1428] Setting key e21b576b3321df5ca6999689432b48e5
I20260619 06:43:05.304575 28756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551: Bootstrap starting.
I20260619 06:43:05.307605 28756 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:05.308722 28756 log.cc:824] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:05.309028 28759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:05.297422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38866 (local address 127.10.192.126:38719)
0619 06:43:05.298477 (+ 1055us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:05.298489 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:05.298533 (+ 44us) server_negotiation.cc:407] Connection header received
0619 06:43:05.300279 (+ 1746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:05.300303 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:05.300770 (+ 467us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:05.301138 (+ 368us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:05.301714 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:05.303011 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:05.304513 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:05.305261 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:05.305462 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:05.306606 (+ 1144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:05.306612 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:05.306626 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:05.307194 (+ 568us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:05.307283 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:05.307304 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:05.307441 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:05.307689 (+ 248us) server_negotiation.cc:299] Negotiation successful
0619 06:43:05.308060 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":358,"threads_started":1}
I20260619 06:43:05.311852 28756 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551: No bootstrap required, opened a new log
I20260619 06:43:05.319376 28756 raft_consensus.cc:348] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f39d06acd8944ca780594c49d38de551" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 38719 } }
I20260619 06:43:05.319828 28756 raft_consensus.cc:374] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:05.319933 28756 raft_consensus.cc:729] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f39d06acd8944ca780594c49d38de551, State: Initialized, Role: FOLLOWER
I20260619 06:43:05.320569 28756 consensus_queue.cc:260] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f39d06acd8944ca780594c49d38de551" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 38719 } }
I20260619 06:43:05.320812 28756 raft_consensus.cc:388] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:05.320967 28756 raft_consensus.cc:482] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:05.321136 28756 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:05.323388 28756 raft_consensus.cc:504] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f39d06acd8944ca780594c49d38de551" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 38719 } }
I20260619 06:43:05.324050 28756 leader_election.cc:302] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f39d06acd8944ca780594c49d38de551; no voters:
I20260619 06:43:05.324782 28756 leader_election.cc:288] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:05.324992 28761 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:05.325773 28761 raft_consensus.cc:686] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551 [term 1 LEADER]: Becoming Leader. State: Replica: f39d06acd8944ca780594c49d38de551, State: Running, Role: LEADER
I20260619 06:43:05.326318 28761 consensus_queue.cc:237] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f39d06acd8944ca780594c49d38de551" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 38719 } }
I20260619 06:43:05.327103 28756 sys_catalog.cc:564] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:05.329493 28763 sys_catalog.cc:455] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f39d06acd8944ca780594c49d38de551. Latest consensus state: current_term: 1 leader_uuid: "f39d06acd8944ca780594c49d38de551" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f39d06acd8944ca780594c49d38de551" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 38719 } } }
I20260619 06:43:05.329952 28763 sys_catalog.cc:458] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:05.330443 28762 sys_catalog.cc:455] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f39d06acd8944ca780594c49d38de551" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f39d06acd8944ca780594c49d38de551" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 38719 } } }
I20260619 06:43:05.330715 28762 sys_catalog.cc:458] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:05.333673 28767 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:05.340711 28767 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:05.351851 28767 catalog_manager.cc:1347] Generated new cluster ID: 97f95574393445ea94098c57cd2b2b06
I20260619 06:43:05.352001 28767 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:05.366271 28767 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:05.367669 28767 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:05.373144 28767 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551: Generated new TSK 0
I20260619 06:43:05.373999 28767 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:05.387091 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:38719
--builtin_ntp_servers=127.10.192.84:35207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260619 06:43:05.747174 28780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:05.747462 28780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:05.747593 28780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:05.755070 28780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:05.755177 28780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:05.755358 28780 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:43:05.765058 28780 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:35207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:38719
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:05.766425 28780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:05.768419 28780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:05.781858 28786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:05.781996 28785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:05.782454 28788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:05.782998 28780 server_base.cc:1034] running on GCE node
I20260619 06:43:05.783833 28780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:05.785028 28780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:05.786281 28780 hybrid_clock.cc:648] HybridClock initialized: now 1781851385786231 us; error 38 us; skew 500 ppm
I20260619 06:43:05.786680 28780 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:43:05.789237 28780 webserver.cc:460] Webserver started at http://127.10.192.65:41701/ using document root <none> and password file <none>
I20260619 06:43:05.789970 28780 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:05.790061 28780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:05.790407 28780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:05.793443 28780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "78febe21aefd4514a5ca98329b2d0cd0"
format_stamp: "Formatted at 2026-06-19 06:43:05 on dist-test-slave-7lz4"
server_key: "e3ac7171e37a238eef85d9f4bea4b3e6"
server_key_iv: "d44c67e6a129eb480f3a9e17d0e1ee1e"
server_key_version: "encryptionkey@0"
I20260619 06:43:05.794258 28780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "78febe21aefd4514a5ca98329b2d0cd0"
format_stamp: "Formatted at 2026-06-19 06:43:05 on dist-test-slave-7lz4"
server_key: "e3ac7171e37a238eef85d9f4bea4b3e6"
server_key_iv: "d44c67e6a129eb480f3a9e17d0e1ee1e"
server_key_version: "encryptionkey@0"
I20260619 06:43:05.799602 28780 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260619 06:43:05.803155 28794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:05.804620 28780 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260619 06:43:05.804800 28780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "78febe21aefd4514a5ca98329b2d0cd0"
format_stamp: "Formatted at 2026-06-19 06:43:05 on dist-test-slave-7lz4"
server_key: "e3ac7171e37a238eef85d9f4bea4b3e6"
server_key_iv: "d44c67e6a129eb480f3a9e17d0e1ee1e"
server_key_version: "encryptionkey@0"
I20260619 06:43:05.805019 28780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:05.830812 28780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:05.831882 28780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:05.832180 28780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:05.833201 28780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:43:05.834721 28780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:43:05.834846 28780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:05.834967 28780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:43:05.835055 28780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:05.868559 28780 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:34963
I20260619 06:43:05.868616 28906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:34963 every 8 connection(s)
I20260619 06:43:05.869935 28780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:43:05.876263 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 28780
I20260619 06:43:05.876452 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:43:05.877007 11009 external_mini_cluster.cc:1428] Setting key c9865b5bc95009a4c5aff3de948e99cc
I20260619 06:43:05.879779 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:38719
--builtin_ntp_servers=127.10.192.84:35207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260619 06:43:05.883173 28909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:05.872702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:51903 (local address 127.10.192.126:38719)
0619 06:43:05.873198 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:05.873204 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:05.874444 (+ 1240us) server_negotiation.cc:407] Connection header received
0619 06:43:05.876430 (+ 1986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:05.876439 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:05.876553 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:05.876685 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:05.877836 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:05.878569 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:05.880341 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:05.880756 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:05.880886 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:05.882280 (+ 1394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:05.882285 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:05.882288 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:05.882315 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:05.882353 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:05.882365 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:05.882458 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:05.882694 (+ 236us) server_negotiation.cc:299] Negotiation successful
0619 06:43:05.882826 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":357,"thread_start_us":247,"threads_started":1}
I20260619 06:43:05.884392 28910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:05.873393 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:38719 (local address 127.10.192.65:51903)
0619 06:43:05.874271 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:05.874316 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:05.876150 (+ 1834us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:05.876887 (+ 737us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:05.876896 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:05.876996 (+ 100us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:43:05.877643 (+ 647us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:05.877661 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:05.878749 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:05.878753 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:05.880199 (+ 1446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:05.880211 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:05.880992 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:05.880999 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:05.881225 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:05.881932 (+ 707us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:43:05.881935 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:43:05.881977 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:43:05.882067 (+ 90us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:43:05.882456 (+ 389us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:43:05.882478 (+ 22us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:43:05.882491 (+ 13us) client_negotiation.cc:769] Sending connection context
0619 06:43:05.882669 (+ 178us) client_negotiation.cc:240] Negotiation successful
0619 06:43:05.883153 (+ 484us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":252,"threads_started":1}
I20260619 06:43:05.886049 28907 heartbeater.cc:347] Connected to a master server at 127.10.192.126:38719
I20260619 06:43:05.886417 28907 heartbeater.cc:464] Registering TS with master...
I20260619 06:43:05.887212 28907 heartbeater.cc:511] Master 127.10.192.126:38719 requested a full tablet report, sending...
I20260619 06:43:05.889631 28721 ts_manager.cc:194] Registered new tserver with Master: 78febe21aefd4514a5ca98329b2d0cd0 (127.10.192.65:34963)
I20260619 06:43:05.891904 28721 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.192.65:51903
W20260619 06:43:06.213634 28911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:06.213927 28911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:06.214010 28911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:06.221168 28911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:06.221266 28911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:06.221370 28911 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:43:06.230773 28911 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:35207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:38719
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:06.232082 28911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:06.233779 28911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:06.248142 28917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:06.248190 28916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:06.248214 28919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:06.249078 28911 server_base.cc:1034] running on GCE node
I20260619 06:43:06.249622 28911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:06.250541 28911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:06.251740 28911 hybrid_clock.cc:648] HybridClock initialized: now 1781851386251669 us; error 53 us; skew 500 ppm
I20260619 06:43:06.252065 28911 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:43:06.254410 28911 webserver.cc:460] Webserver started at http://127.10.192.66:36389/ using document root <none> and password file <none>
I20260619 06:43:06.255089 28911 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:06.255173 28911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:06.255424 28911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:06.258419 28911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "8880844cabb84534a49f9a8f9c03a4ca"
format_stamp: "Formatted at 2026-06-19 06:43:06 on dist-test-slave-7lz4"
server_key: "a2787dc5c19058c79e420419ed5b4923"
server_key_iv: "fce5ae87f3965f205afbd3135ed4116b"
server_key_version: "encryptionkey@0"
I20260619 06:43:06.259219 28911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "8880844cabb84534a49f9a8f9c03a4ca"
format_stamp: "Formatted at 2026-06-19 06:43:06 on dist-test-slave-7lz4"
server_key: "a2787dc5c19058c79e420419ed5b4923"
server_key_iv: "fce5ae87f3965f205afbd3135ed4116b"
server_key_version: "encryptionkey@0"
I20260619 06:43:06.264696 28911 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260619 06:43:06.268337 28925 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:06.269858 28911 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260619 06:43:06.270089 28911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "8880844cabb84534a49f9a8f9c03a4ca"
format_stamp: "Formatted at 2026-06-19 06:43:06 on dist-test-slave-7lz4"
server_key: "a2787dc5c19058c79e420419ed5b4923"
server_key_iv: "fce5ae87f3965f205afbd3135ed4116b"
server_key_version: "encryptionkey@0"
I20260619 06:43:06.270365 28911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:06.293152 28911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:06.294155 28911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:06.294519 28911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:06.295816 28911 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:43:06.297554 28911 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:43:06.297668 28911 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:06.297844 28911 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:43:06.297950 28911 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:06.335371 28911 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:42913
I20260619 06:43:06.335428 29037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:42913 every 8 connection(s)
I20260619 06:43:06.336972 28911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:43:06.346994 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 28911
I20260619 06:43:06.347225 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:43:06.347769 11009 external_mini_cluster.cc:1428] Setting key 885257efebba72edb4682e33c7716309
I20260619 06:43:06.349911 28909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:06.339851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:52487 (local address 127.10.192.126:38719)
0619 06:43:06.340045 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:06.340050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:06.341575 (+ 1525us) server_negotiation.cc:407] Connection header received
0619 06:43:06.343468 (+ 1893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:06.343475 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:06.343568 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:06.343696 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:06.344748 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.345490 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.347021 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.347541 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.347689 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:06.349112 (+ 1423us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:06.349118 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:06.349121 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:06.349139 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:06.349171 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:06.349183 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:06.349276 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:06.349495 (+ 219us) server_negotiation.cc:299] Negotiation successful
0619 06:43:06.349592 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260619 06:43:06.350986 29040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:06.340441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:38719 (local address 127.10.192.66:52487)
0619 06:43:06.341405 (+ 964us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:06.341442 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:06.343200 (+ 1758us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:06.343936 (+ 736us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:06.343944 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:06.344038 (+ 94us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:43:06.344586 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:06.344602 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.345642 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.345647 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:06.346886 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:06.346898 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.347783 (+ 885us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.347790 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:06.348065 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:06.348784 (+ 719us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:43:06.348787 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:43:06.348839 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:43:06.348920 (+ 81us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:43:06.349273 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:43:06.349285 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:43:06.349293 (+ 8us) client_negotiation.cc:769] Sending connection context
0619 06:43:06.349471 (+ 178us) client_negotiation.cc:240] Negotiation successful
0619 06:43:06.349884 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"thread_start_us":341,"threads_started":1}
I20260619 06:43:06.351078 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:38719
--builtin_ntp_servers=127.10.192.84:35207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260619 06:43:06.352489 29038 heartbeater.cc:347] Connected to a master server at 127.10.192.126:38719
I20260619 06:43:06.352892 29038 heartbeater.cc:464] Registering TS with master...
I20260619 06:43:06.353950 29038 heartbeater.cc:511] Master 127.10.192.126:38719 requested a full tablet report, sending...
I20260619 06:43:06.355711 28721 ts_manager.cc:194] Registered new tserver with Master: 8880844cabb84534a49f9a8f9c03a4ca (127.10.192.66:42913)
I20260619 06:43:06.356568 28721 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.192.66:52487
W20260619 06:43:06.683851 29041 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:06.684162 29041 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:06.684319 29041 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:06.691833 29041 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:06.691934 29041 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:06.692101 29041 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:43:06.701686 29041 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:35207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:38719
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:06.703109 29041 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:06.705070 29041 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:06.720263 29046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:06.720369 29047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:06.720453 29049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:06.721572 29041 server_base.cc:1034] running on GCE node
I20260619 06:43:06.722271 29041 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:06.723289 29041 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:06.724565 29041 hybrid_clock.cc:648] HybridClock initialized: now 1781851386724507 us; error 42 us; skew 500 ppm
I20260619 06:43:06.724921 29041 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:43:06.727551 29041 webserver.cc:460] Webserver started at http://127.10.192.67:33327/ using document root <none> and password file <none>
I20260619 06:43:06.728343 29041 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:06.728454 29041 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:06.728786 29041 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:06.731972 29041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "c132c23efc47418989e7505d1cd5d395"
format_stamp: "Formatted at 2026-06-19 06:43:06 on dist-test-slave-7lz4"
server_key: "22ef2caf4ff27377cea6dfdc20f9e7a3"
server_key_iv: "acc5da854908a3a0c3825d240231b691"
server_key_version: "encryptionkey@0"
I20260619 06:43:06.732788 29041 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "c132c23efc47418989e7505d1cd5d395"
format_stamp: "Formatted at 2026-06-19 06:43:06 on dist-test-slave-7lz4"
server_key: "22ef2caf4ff27377cea6dfdc20f9e7a3"
server_key_iv: "acc5da854908a3a0c3825d240231b691"
server_key_version: "encryptionkey@0"
I20260619 06:43:06.738039 29041 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 06:43:06.741503 29055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:06.742839 29041 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 06:43:06.743021 29041 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "c132c23efc47418989e7505d1cd5d395"
format_stamp: "Formatted at 2026-06-19 06:43:06 on dist-test-slave-7lz4"
server_key: "22ef2caf4ff27377cea6dfdc20f9e7a3"
server_key_iv: "acc5da854908a3a0c3825d240231b691"
server_key_version: "encryptionkey@0"
I20260619 06:43:06.743227 29041 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:06.772784 29041 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:06.773705 29041 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:06.774009 29041 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:06.775007 29041 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:43:06.776613 29041 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:43:06.776738 29041 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:06.776859 29041 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:43:06.776942 29041 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:06.810163 29041 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:45465
I20260619 06:43:06.810209 29167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:45465 every 8 connection(s)
I20260619 06:43:06.811522 29041 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:43:06.818886 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 29041
I20260619 06:43:06.819079 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:43:06.819584 11009 external_mini_cluster.cc:1428] Setting key 08c5068565d8595de48cf5f60ad3cd89
I20260619 06:43:06.824635 28909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:06.814059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:35421 (local address 127.10.192.126:38719)
0619 06:43:06.814281 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:06.814287 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:06.815686 (+ 1399us) server_negotiation.cc:407] Connection header received
0619 06:43:06.817408 (+ 1722us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:06.817412 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:06.817477 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:06.817574 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:06.818593 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.819442 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.821570 (+ 2128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.822156 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.822301 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:06.823792 (+ 1491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:06.823797 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:06.823801 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:06.823818 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:06.823851 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:06.823863 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:06.823973 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:06.824199 (+ 226us) server_negotiation.cc:299] Negotiation successful
0619 06:43:06.824300 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260619 06:43:06.825732 29170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:06.814622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:38719 (local address 127.10.192.67:35421)
0619 06:43:06.815501 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:06.815542 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:06.817168 (+ 1626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:06.817765 (+ 597us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:06.817772 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:06.817859 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:43:06.818426 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:06.818447 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.819588 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.819594 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:06.821410 (+ 1816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:06.821422 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.822386 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.822406 (+ 20us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:06.822712 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:06.823426 (+ 714us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:43:06.823429 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:43:06.823474 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:43:06.823554 (+ 80us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:43:06.823972 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:43:06.823983 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:43:06.823993 (+ 10us) client_negotiation.cc:769] Sending connection context
0619 06:43:06.824175 (+ 182us) client_negotiation.cc:240] Negotiation successful
0619 06:43:06.824612 (+ 437us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":264,"threads_started":1}
I20260619 06:43:06.827073 29168 heartbeater.cc:347] Connected to a master server at 127.10.192.126:38719
I20260619 06:43:06.827368 29168 heartbeater.cc:464] Registering TS with master...
I20260619 06:43:06.828188 29168 heartbeater.cc:511] Master 127.10.192.126:38719 requested a full tablet report, sending...
I20260619 06:43:06.829543 28721 ts_manager.cc:194] Registered new tserver with Master: c132c23efc47418989e7505d1cd5d395 (127.10.192.67:45465)
I20260619 06:43:06.830349 28721 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.192.67:35421
I20260619 06:43:06.834887 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 06:43:06.844996 28909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:06.839062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38878 (local address 127.10.192.126:38719)
0619 06:43:06.839285 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:06.839293 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:06.839749 (+ 456us) server_negotiation.cc:407] Connection header received
0619 06:43:06.839897 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:06.839901 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:06.839987 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:06.840070 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:06.840566 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.841270 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.842646 (+ 1376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.843077 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.843177 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:06.844245 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:06.844250 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:06.844253 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:06.844271 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:06.844303 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:06.844315 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:06.844381 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:06.844559 (+ 178us) server_negotiation.cc:299] Negotiation successful
0619 06:43:06.844634 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260619 06:43:06.848764 28721 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38878:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:43:06.855626 28721 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:43:06.884481 29181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:06.873457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47898 (local address 127.10.192.65:34963)
0619 06:43:06.874231 (+ 774us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:06.874239 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:06.874339 (+ 100us) server_negotiation.cc:407] Connection header received
0619 06:43:06.874456 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:06.874464 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:06.874772 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:06.876000 (+ 1228us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:06.876275 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.878382 (+ 2107us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.881840 (+ 3458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.883164 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.883311 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:06.883784 (+ 473us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:06.883904 (+ 120us) server_negotiation.cc:299] Negotiation successful
0619 06:43:06.884091 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":462,"threads_started":1}
I20260619 06:43:06.884531 29180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:06.873144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34963 (local address 127.0.0.1:47898)
0619 06:43:06.873900 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:06.873950 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:06.874125 (+ 175us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:06.875081 (+ 956us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:06.875089 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:06.875126 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:06.875650 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:06.875667 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.878585 (+ 2918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.878595 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:06.881628 (+ 3033us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:06.881643 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.883390 (+ 1747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.883397 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:06.883614 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:06.883702 (+ 88us) client_negotiation.cc:769] Sending connection context
0619 06:43:06.883856 (+ 154us) client_negotiation.cc:240] Negotiation successful
0619 06:43:06.884061 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"mutex_wait_us":1,"thread_start_us":284,"threads_started":1}
I20260619 06:43:06.887408 29184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:06.874819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:42913 (local address 127.0.0.1:51890)
0619 06:43:06.879139 (+ 4320us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:06.879163 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:06.879326 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:06.880086 (+ 760us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:06.880096 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:06.880123 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:06.880558 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:06.880574 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.882282 (+ 1708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.882288 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:06.884304 (+ 2016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:06.884318 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.886566 (+ 2248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.886572 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:06.886747 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:06.886778 (+ 31us) client_negotiation.cc:769] Sending connection context
0619 06:43:06.886895 (+ 117us) client_negotiation.cc:240] Negotiation successful
0619 06:43:06.887036 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4131,"mutex_wait_us":25,"thread_start_us":3926,"threads_started":1}
I20260619 06:43:06.887460 29185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:06.875365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51890 (local address 127.10.192.66:42913)
0619 06:43:06.875940 (+ 575us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:06.875951 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:06.879302 (+ 3351us) server_negotiation.cc:407] Connection header received
0619 06:43:06.879537 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:06.879546 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:06.879871 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:06.880084 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:06.880770 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.882141 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.884546 (+ 2405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.886368 (+ 1822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.886509 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:06.886741 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:06.886948 (+ 207us) server_negotiation.cc:299] Negotiation successful
0619 06:43:06.887113 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":291,"threads_started":1}
I20260619 06:43:06.888808 29182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:06.874257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:45465 (local address 127.0.0.1:42336)
0619 06:43:06.874819 (+ 562us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:06.874835 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:06.874952 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:06.880642 (+ 5690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:06.880647 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:06.880671 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:06.881077 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:06.881088 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.882903 (+ 1815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.882910 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:06.885786 (+ 2876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:06.885803 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.888029 (+ 2226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.888036 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:06.888201 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:06.888234 (+ 33us) client_negotiation.cc:769] Sending connection context
0619 06:43:06.888348 (+ 114us) client_negotiation.cc:240] Negotiation successful
0619 06:43:06.888488 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":882,"threads_started":1}
I20260619 06:43:06.888939 29183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:06.874766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42336 (local address 127.10.192.67:45465)
0619 06:43:06.879993 (+ 5227us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:06.879999 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:06.880059 (+ 60us) server_negotiation.cc:407] Connection header received
0619 06:43:06.880150 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:06.880159 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:06.880434 (+ 275us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:06.880640 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:06.881331 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.882713 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.886012 (+ 3299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:06.887453 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:06.887597 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:06.887907 (+ 310us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:06.888420 (+ 513us) server_negotiation.cc:299] Negotiation successful
0619 06:43:06.888600 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5063,"thread_start_us":4912,"threads_started":1}
I20260619 06:43:06.889120 28842 tablet_service.cc:1467] Processing CreateTablet for tablet 1366251ae4174903ae2cf17f9e2ceb35 (DEFAULT_TABLE table=test-table [id=7b02adbe037b43a69c19ca4f1fba7ece]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:43:06.891464 28842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1366251ae4174903ae2cf17f9e2ceb35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:06.891083 28973 tablet_service.cc:1467] Processing CreateTablet for tablet 1366251ae4174903ae2cf17f9e2ceb35 (DEFAULT_TABLE table=test-table [id=7b02adbe037b43a69c19ca4f1fba7ece]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:43:06.892485 28973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1366251ae4174903ae2cf17f9e2ceb35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:06.892607 29103 tablet_service.cc:1467] Processing CreateTablet for tablet 1366251ae4174903ae2cf17f9e2ceb35 (DEFAULT_TABLE table=test-table [id=7b02adbe037b43a69c19ca4f1fba7ece]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:43:06.894007 29103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1366251ae4174903ae2cf17f9e2ceb35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:06.896018 28907 heartbeater.cc:503] Master 127.10.192.126:38719 was elected leader, sending a full tablet report...
I20260619 06:43:06.903983 29186 tablet_bootstrap.cc:492] T 1366251ae4174903ae2cf17f9e2ceb35 P 78febe21aefd4514a5ca98329b2d0cd0: Bootstrap starting.
I20260619 06:43:06.907174 29186 tablet_bootstrap.cc:654] T 1366251ae4174903ae2cf17f9e2ceb35 P 78febe21aefd4514a5ca98329b2d0cd0: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:06.908558 29186 log.cc:824] T 1366251ae4174903ae2cf17f9e2ceb35 P 78febe21aefd4514a5ca98329b2d0cd0: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:06.908960 29187 tablet_bootstrap.cc:492] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca: Bootstrap starting.
I20260619 06:43:06.912662 29188 tablet_bootstrap.cc:492] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395: Bootstrap starting.
I20260619 06:43:06.913702 29187 tablet_bootstrap.cc:654] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:06.914458 29186 tablet_bootstrap.cc:492] T 1366251ae4174903ae2cf17f9e2ceb35 P 78febe21aefd4514a5ca98329b2d0cd0: No bootstrap required, opened a new log
I20260619 06:43:06.914744 29186 ts_tablet_manager.cc:1397] T 1366251ae4174903ae2cf17f9e2ceb35 P 78febe21aefd4514a5ca98329b2d0cd0: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.003s
I20260619 06:43:06.915982 29187 log.cc:824] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:06.916611 29188 tablet_bootstrap.cc:654] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:06.917729 29188 log.cc:824] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:06.919466 29187 tablet_bootstrap.cc:492] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca: No bootstrap required, opened a new log
I20260619 06:43:06.919782 29187 ts_tablet_manager.cc:1397] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.007s
I20260619 06:43:06.921494 29188 tablet_bootstrap.cc:492] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395: No bootstrap required, opened a new log
I20260619 06:43:06.921789 29188 ts_tablet_manager.cc:1397] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260619 06:43:06.923372 29186 raft_consensus.cc:348] T 1366251ae4174903ae2cf17f9e2ceb35 P 78febe21aefd4514a5ca98329b2d0cd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78febe21aefd4514a5ca98329b2d0cd0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34963 } } peers { permanent_uuid: "c132c23efc47418989e7505d1cd5d395" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 45465 } } peers { permanent_uuid: "8880844cabb84534a49f9a8f9c03a4ca" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42913 } }
I20260619 06:43:06.923823 29186 raft_consensus.cc:374] T 1366251ae4174903ae2cf17f9e2ceb35 P 78febe21aefd4514a5ca98329b2d0cd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:06.923943 29186 raft_consensus.cc:729] T 1366251ae4174903ae2cf17f9e2ceb35 P 78febe21aefd4514a5ca98329b2d0cd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78febe21aefd4514a5ca98329b2d0cd0, State: Initialized, Role: FOLLOWER
I20260619 06:43:06.924563 29186 consensus_queue.cc:260] T 1366251ae4174903ae2cf17f9e2ceb35 P 78febe21aefd4514a5ca98329b2d0cd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78febe21aefd4514a5ca98329b2d0cd0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34963 } } peers { permanent_uuid: "c132c23efc47418989e7505d1cd5d395" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 45465 } } peers { permanent_uuid: "8880844cabb84534a49f9a8f9c03a4ca" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42913 } }
I20260619 06:43:06.926395 29186 ts_tablet_manager.cc:1428] T 1366251ae4174903ae2cf17f9e2ceb35 P 78febe21aefd4514a5ca98329b2d0cd0: Time spent starting tablet: real 0.012s user 0.012s sys 0.001s
I20260619 06:43:06.931041 29187 raft_consensus.cc:348] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78febe21aefd4514a5ca98329b2d0cd0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34963 } } peers { permanent_uuid: "c132c23efc47418989e7505d1cd5d395" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 45465 } } peers { permanent_uuid: "8880844cabb84534a49f9a8f9c03a4ca" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42913 } }
I20260619 06:43:06.931536 29187 raft_consensus.cc:374] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:06.931659 29187 raft_consensus.cc:729] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8880844cabb84534a49f9a8f9c03a4ca, State: Initialized, Role: FOLLOWER
I20260619 06:43:06.932343 29187 consensus_queue.cc:260] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78febe21aefd4514a5ca98329b2d0cd0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34963 } } peers { permanent_uuid: "c132c23efc47418989e7505d1cd5d395" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 45465 } } peers { permanent_uuid: "8880844cabb84534a49f9a8f9c03a4ca" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42913 } }
I20260619 06:43:06.932730 29188 raft_consensus.cc:348] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78febe21aefd4514a5ca98329b2d0cd0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34963 } } peers { permanent_uuid: "c132c23efc47418989e7505d1cd5d395" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 45465 } } peers { permanent_uuid: "8880844cabb84534a49f9a8f9c03a4ca" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42913 } }
I20260619 06:43:06.933198 29188 raft_consensus.cc:374] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:06.933306 29188 raft_consensus.cc:729] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c132c23efc47418989e7505d1cd5d395, State: Initialized, Role: FOLLOWER
I20260619 06:43:06.933465 29038 heartbeater.cc:503] Master 127.10.192.126:38719 was elected leader, sending a full tablet report...
I20260619 06:43:06.933892 29188 consensus_queue.cc:260] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78febe21aefd4514a5ca98329b2d0cd0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34963 } } peers { permanent_uuid: "c132c23efc47418989e7505d1cd5d395" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 45465 } } peers { permanent_uuid: "8880844cabb84534a49f9a8f9c03a4ca" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42913 } }
I20260619 06:43:06.934254 29187 ts_tablet_manager.cc:1428] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20260619 06:43:06.935035 29168 heartbeater.cc:503] Master 127.10.192.126:38719 was elected leader, sending a full tablet report...
I20260619 06:43:06.935708 29188 ts_tablet_manager.cc:1428] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395: Time spent starting tablet: real 0.014s user 0.000s sys 0.015s
I20260619 06:43:07.034034 29193 raft_consensus.cc:482] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:43:07.034399 29193 raft_consensus.cc:504] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78febe21aefd4514a5ca98329b2d0cd0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34963 } } peers { permanent_uuid: "c132c23efc47418989e7505d1cd5d395" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 45465 } } peers { permanent_uuid: "8880844cabb84534a49f9a8f9c03a4ca" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42913 } }
I20260619 06:43:07.036315 29193 leader_election.cc:288] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 78febe21aefd4514a5ca98329b2d0cd0 (127.10.192.65:34963), c132c23efc47418989e7505d1cd5d395 (127.10.192.67:45465)
I20260619 06:43:07.045841 29181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:07.036720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:41215 (local address 127.10.192.65:34963)
0619 06:43:07.036972 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:07.036981 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:07.037574 (+ 593us) server_negotiation.cc:407] Connection header received
0619 06:43:07.037956 (+ 382us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:07.037965 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:07.038070 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:07.038144 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:07.039045 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:07.040159 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:07.043422 (+ 3263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:07.044680 (+ 1258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:07.044846 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:07.044916 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:07.045452 (+ 536us) server_negotiation.cc:299] Negotiation successful
0619 06:43:07.045582 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260619 06:43:07.045882 29183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:07.037871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:44621 (local address 127.10.192.67:45465)
0619 06:43:07.038078 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:07.038090 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:07.038302 (+ 212us) server_negotiation.cc:407] Connection header received
0619 06:43:07.038485 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:07.038489 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:07.038551 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:07.038626 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:07.039285 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:07.040348 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:07.043421 (+ 3073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:07.044684 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:07.044878 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:07.044942 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:07.045452 (+ 510us) server_negotiation.cc:299] Negotiation successful
0619 06:43:07.045581 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260619 06:43:07.046089 29195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:07.036692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34963 (local address 127.10.192.66:41215)
0619 06:43:07.037449 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:07.037471 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:07.037679 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:07.038369 (+ 690us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:07.038375 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:07.038400 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:07.038892 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:07.038910 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:07.040303 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:07.040307 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:07.043167 (+ 2860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:07.043183 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:07.044933 (+ 1750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:07.044941 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:07.045207 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:07.045297 (+ 90us) client_negotiation.cc:769] Sending connection context
0619 06:43:07.045416 (+ 119us) client_negotiation.cc:240] Negotiation successful
0619 06:43:07.045641 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":583,"mutex_wait_us":240,"thread_start_us":416,"threads_started":1}
I20260619 06:43:07.046536 29196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:07.037461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:45465 (local address 127.10.192.66:44621)
0619 06:43:07.038210 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:07.038228 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:07.038369 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:07.038674 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:07.038684 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:07.038712 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:07.039138 (+ 426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:07.039147 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:07.040470 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:07.040475 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:07.043171 (+ 2696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:07.043183 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:07.044941 (+ 1758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:07.044947 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:07.045210 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:07.045295 (+ 85us) client_negotiation.cc:769] Sending connection context
0619 06:43:07.045416 (+ 121us) client_negotiation.cc:240] Negotiation successful
0619 06:43:07.045641 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"mutex_wait_us":196,"thread_start_us":406,"threads_started":1}
I20260619 06:43:07.047371 28862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1366251ae4174903ae2cf17f9e2ceb35" candidate_uuid: "8880844cabb84534a49f9a8f9c03a4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78febe21aefd4514a5ca98329b2d0cd0" is_pre_election: true
I20260619 06:43:07.047705 29123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1366251ae4174903ae2cf17f9e2ceb35" candidate_uuid: "8880844cabb84534a49f9a8f9c03a4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c132c23efc47418989e7505d1cd5d395" is_pre_election: true
I20260619 06:43:07.048086 28862 raft_consensus.cc:2454] T 1366251ae4174903ae2cf17f9e2ceb35 P 78febe21aefd4514a5ca98329b2d0cd0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8880844cabb84534a49f9a8f9c03a4ca in term 0.
I20260619 06:43:07.048275 29123 raft_consensus.cc:2454] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8880844cabb84534a49f9a8f9c03a4ca in term 0.
I20260619 06:43:07.048780 28929 leader_election.cc:302] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78febe21aefd4514a5ca98329b2d0cd0, 8880844cabb84534a49f9a8f9c03a4ca; no voters:
I20260619 06:43:07.049118 29193 raft_consensus.cc:2781] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:43:07.049274 29193 raft_consensus.cc:482] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:43:07.049414 29193 raft_consensus.cc:3037] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:07.052147 29193 raft_consensus.cc:504] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78febe21aefd4514a5ca98329b2d0cd0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34963 } } peers { permanent_uuid: "c132c23efc47418989e7505d1cd5d395" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 45465 } } peers { permanent_uuid: "8880844cabb84534a49f9a8f9c03a4ca" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42913 } }
I20260619 06:43:07.052736 29193 leader_election.cc:288] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [CANDIDATE]: Term 1 election: Requested vote from peers 78febe21aefd4514a5ca98329b2d0cd0 (127.10.192.65:34963), c132c23efc47418989e7505d1cd5d395 (127.10.192.67:45465)
I20260619 06:43:07.053195 28862 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1366251ae4174903ae2cf17f9e2ceb35" candidate_uuid: "8880844cabb84534a49f9a8f9c03a4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78febe21aefd4514a5ca98329b2d0cd0"
I20260619 06:43:07.053275 29123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1366251ae4174903ae2cf17f9e2ceb35" candidate_uuid: "8880844cabb84534a49f9a8f9c03a4ca" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c132c23efc47418989e7505d1cd5d395"
I20260619 06:43:07.053407 28862 raft_consensus.cc:3037] T 1366251ae4174903ae2cf17f9e2ceb35 P 78febe21aefd4514a5ca98329b2d0cd0 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:07.053498 29123 raft_consensus.cc:3037] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:07.055688 28862 raft_consensus.cc:2454] T 1366251ae4174903ae2cf17f9e2ceb35 P 78febe21aefd4514a5ca98329b2d0cd0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8880844cabb84534a49f9a8f9c03a4ca in term 1.
I20260619 06:43:07.055852 29123 raft_consensus.cc:2454] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8880844cabb84534a49f9a8f9c03a4ca in term 1.
I20260619 06:43:07.056099 28929 leader_election.cc:302] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 78febe21aefd4514a5ca98329b2d0cd0, 8880844cabb84534a49f9a8f9c03a4ca; no voters:
I20260619 06:43:07.056442 29193 raft_consensus.cc:2781] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:07.056918 29193 raft_consensus.cc:686] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [term 1 LEADER]: Becoming Leader. State: Replica: 8880844cabb84534a49f9a8f9c03a4ca, State: Running, Role: LEADER
I20260619 06:43:07.057472 29193 consensus_queue.cc:237] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78febe21aefd4514a5ca98329b2d0cd0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34963 } } peers { permanent_uuid: "c132c23efc47418989e7505d1cd5d395" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 45465 } } peers { permanent_uuid: "8880844cabb84534a49f9a8f9c03a4ca" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42913 } }
W20260619 06:43:07.063161 29169 tablet.cc:2369] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:43:07.062791 28720 catalog_manager.cc:5495] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca reported cstate change: term changed from 0 to 1, leader changed from <none> to 8880844cabb84534a49f9a8f9c03a4ca (127.10.192.66). New cstate: current_term: 1 leader_uuid: "8880844cabb84534a49f9a8f9c03a4ca" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "78febe21aefd4514a5ca98329b2d0cd0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c132c23efc47418989e7505d1cd5d395" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 45465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8880844cabb84534a49f9a8f9c03a4ca" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 42913 } health_report { overall_health: HEALTHY } } }
I20260619 06:43:07.083374 29185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:07.078314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51898 (local address 127.10.192.66:42913)
0619 06:43:07.078481 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:07.078485 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:07.078502 (+ 17us) server_negotiation.cc:407] Connection header received
0619 06:43:07.078647 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:07.078650 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:07.078746 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:07.078874 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:43:07.079201 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:07.079963 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:07.081268 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:07.081677 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:07.081776 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:07.082314 (+ 538us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:43:07.082841 (+ 527us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:43:07.082967 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:07.083081 (+ 114us) server_negotiation.cc:299] Negotiation successful
0619 06:43:07.083145 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260619 06:43:07.089301 29039 tablet.cc:2369] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:43:07.092206 28862 raft_consensus.cc:1261] T 1366251ae4174903ae2cf17f9e2ceb35 P 78febe21aefd4514a5ca98329b2d0cd0 [term 1 FOLLOWER]: Refusing update from remote peer 8880844cabb84534a49f9a8f9c03a4ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:43:07.092242 29123 raft_consensus.cc:1261] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395 [term 1 FOLLOWER]: Refusing update from remote peer 8880844cabb84534a49f9a8f9c03a4ca: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:43:07.093199 29193 consensus_queue.cc:1035] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "78febe21aefd4514a5ca98329b2d0cd0" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:43:07.093546 29197 consensus_queue.cc:1035] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [LEADER]: Connected to new peer: Peer: permanent_uuid: "c132c23efc47418989e7505d1cd5d395" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 45465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:43:07.110759 29202 mvcc.cc:205] Tried to move back new op lower bound from 7298463281519431680 to 7298463281392103424. Current Snapshot: MvccSnapshot[applied={T|T < 7298463281519431680}]
I20260619 06:43:07.119292 28720 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:43:07.119583 28720 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38878:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:43:07.123359 28720 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f39d06acd8944ca780594c49d38de551: Sending DeleteTablet for 3 replicas of tablet 1366251ae4174903ae2cf17f9e2ceb35
I20260619 06:43:07.124537 28842 tablet_service.cc:1514] Processing DeleteTablet for tablet 1366251ae4174903ae2cf17f9e2ceb35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:43:07 UTC) from {username='slave'} at 127.0.0.1:47898
I20260619 06:43:07.124644 29103 tablet_service.cc:1514] Processing DeleteTablet for tablet 1366251ae4174903ae2cf17f9e2ceb35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:43:07 UTC) from {username='slave'} at 127.0.0.1:42336
I20260619 06:43:07.124653 28973 tablet_service.cc:1514] Processing DeleteTablet for tablet 1366251ae4174903ae2cf17f9e2ceb35 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:43:07 UTC) from {username='slave'} at 127.0.0.1:51890
I20260619 06:43:07.127923 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 28780
I20260619 06:43:07.141844 29211 tablet_replica.cc:330] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca: stopping tablet replica
I20260619 06:43:07.142728 29211 raft_consensus.cc:2229] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:43:07.143739 29211 raft_consensus.cc:2258] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:43:07.144662 29210 tablet_replica.cc:330] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395: stopping tablet replica
I20260619 06:43:07.145076 29210 raft_consensus.cc:2229] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:43:07.145617 29210 raft_consensus.cc:2258] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:43:07.145646 29209 tablet_replica.cc:330] T 1366251ae4174903ae2cf17f9e2ceb35 P 78febe21aefd4514a5ca98329b2d0cd0: stopping tablet replica
I20260619 06:43:07.146111 29209 raft_consensus.cc:2229] T 1366251ae4174903ae2cf17f9e2ceb35 P 78febe21aefd4514a5ca98329b2d0cd0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:43:07.146726 29209 raft_consensus.cc:2258] T 1366251ae4174903ae2cf17f9e2ceb35 P 78febe21aefd4514a5ca98329b2d0cd0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:43:07.148285 29211 ts_tablet_manager.cc:1905] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:43:07.149061 29210 ts_tablet_manager.cc:1905] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:43:07.153398 29209 ts_tablet_manager.cc:1905] T 1366251ae4174903ae2cf17f9e2ceb35 P 78febe21aefd4514a5ca98329b2d0cd0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:43:07.155925 29210 ts_tablet_manager.cc:1918] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:43:07.155932 29211 ts_tablet_manager.cc:1918] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:43:07.155467 29181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:07.129139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47900 (local address 127.10.192.65:34963)
0619 06:43:07.129321 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:07.129327 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:07.144953 (+ 15626us) server_negotiation.cc:407] Connection header received
0619 06:43:07.145173 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:07.145178 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:07.145299 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:07.145452 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:07.146266 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:07.147527 (+ 1261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:07.149802 (+ 2275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:07.150426 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:07.150527 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:07.153732 (+ 3205us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:07.153743 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:07.153760 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:07.154533 (+ 773us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:07.154602 (+ 69us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:07.154628 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:07.154720 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:07.154990 (+ 270us) server_negotiation.cc:299] Negotiation successful
0619 06:43:07.155111 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260619 06:43:07.156091 29210 log.cc:1196] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/1366251ae4174903ae2cf17f9e2ceb35
I20260619 06:43:07.156098 29211 log.cc:1196] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/1366251ae4174903ae2cf17f9e2ceb35
I20260619 06:43:07.156632 29210 ts_tablet_manager.cc:1939] T 1366251ae4174903ae2cf17f9e2ceb35 P c132c23efc47418989e7505d1cd5d395: Deleting consensus metadata
I20260619 06:43:07.156637 29211 ts_tablet_manager.cc:1939] T 1366251ae4174903ae2cf17f9e2ceb35 P 8880844cabb84534a49f9a8f9c03a4ca: Deleting consensus metadata
I20260619 06:43:07.157045 28902 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:07.158452 28706 catalog_manager.cc:4841] TS 8880844cabb84534a49f9a8f9c03a4ca (127.10.192.66:42913): tablet 1366251ae4174903ae2cf17f9e2ceb35 (table test-table [id=7b02adbe037b43a69c19ca4f1fba7ece]) successfully deleted
I20260619 06:43:07.158567 28708 catalog_manager.cc:4841] TS c132c23efc47418989e7505d1cd5d395 (127.10.192.67:45465): tablet 1366251ae4174903ae2cf17f9e2ceb35 (table test-table [id=7b02adbe037b43a69c19ca4f1fba7ece]) successfully deleted
I20260619 06:43:07.249879 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 28780
I20260619 06:43:07.268486 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 28911
W20260619 06:43:07.268545 28708 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.192.65:34963 (error 108)
I20260619 06:43:07.270654 29182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:07.270088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34963 (local address 127.0.0.1:47914)
0619 06:43:07.270299 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:07.270443 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:34963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260619 06:43:07.271087 28708 catalog_manager.cc:4584] TS 78febe21aefd4514a5ca98329b2d0cd0 (127.10.192.65:34963): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1366251ae4174903ae2cf17f9e2ceb35: Network error: Client connection negotiation failed: client connection to 127.10.192.65:34963: connect: Connection refused (error 111)
I20260619 06:43:07.278297 29185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:07.269364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51910 (local address 127.10.192.66:42913)
0619 06:43:07.269562 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:07.269568 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:07.270497 (+ 929us) server_negotiation.cc:407] Connection header received
0619 06:43:07.270701 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:07.270707 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:07.270821 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:07.270934 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:07.271692 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:07.272500 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:07.274705 (+ 2205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:07.275219 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:07.275340 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:07.276803 (+ 1463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:07.276813 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:07.276827 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:07.277460 (+ 633us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:07.277525 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:07.277545 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:07.277641 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:07.277804 (+ 163us) server_negotiation.cc:299] Negotiation successful
0619 06:43:07.277887 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 06:43:07.278956 29033 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:07.324846 29182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:07.324249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34963 (local address 127.0.0.1:47926)
0619 06:43:07.324498 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:07.324623 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:34963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260619 06:43:07.325996 29182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:07.325565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34963 (local address 127.0.0.1:47940)
0619 06:43:07.325733 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:07.325829 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:34963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260619 06:43:07.386718 29182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:07.386206 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34963 (local address 127.0.0.1:47948)
0619 06:43:07.386451 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:07.386564 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:34963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
I20260619 06:43:07.388087 29182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:07.387520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34963 (local address 127.0.0.1:47958)
0619 06:43:07.387740 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:07.387859 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:34963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260619 06:43:07.400111 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 28911
I20260619 06:43:07.419267 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 29041
I20260619 06:43:07.426218 29183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:07.420077 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42340 (local address 127.10.192.67:45465)
0619 06:43:07.420248 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:07.420253 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:07.420271 (+ 18us) server_negotiation.cc:407] Connection header received
0619 06:43:07.420356 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:07.420360 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:07.420465 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:07.420551 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:07.420966 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:07.421714 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:07.423089 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:07.423552 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:07.423718 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:07.424855 (+ 1137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:07.424866 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:07.424882 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:07.425460 (+ 578us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:07.425511 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:07.425530 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:07.425622 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:07.425783 (+ 161us) server_negotiation.cc:299] Negotiation successful
0619 06:43:07.425873 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260619 06:43:07.427003 29163 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:07.468982 29182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:07.468378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34963 (local address 127.0.0.1:47966)
0619 06:43:07.468635 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:07.468761 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:34963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260619 06:43:07.470125 29182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:07.469682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34963 (local address 127.0.0.1:47982)
0619 06:43:07.469893 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:07.469976 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:34963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260619 06:43:07.516875 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 29041
I20260619 06:43:07.534135 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 28690
I20260619 06:43:07.535284 28751 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:07.646378 29182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:07.645827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34963 (local address 127.0.0.1:47994)
0619 06:43:07.646034 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:07.646149 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:34963: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260619 06:43:07.646353 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 28690
2026-06-19T06:43:07Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2865 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:07 dist-test-slave-7lz4 krb5kdc[29220](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:07 dist-test-slave-7lz4 krb5kdc[29220](info): set up 2 sockets
Jun 19 06:43:07 dist-test-slave-7lz4 krb5kdc[29220](info): commencing operation
krb5kdc: starting...
W20260619 06:43:08.752005 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.002s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:08 dist-test-slave-7lz4 krb5kdc[29220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:43:09.011127 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:36171
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:33785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:36171
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:09.342935 29233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:09.343292 29233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:09.343459 29233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:09.350826 29233 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:09.351004 29233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:09.351116 29233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:09.351222 29233 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:09.351300 29233 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:09.361510 29233 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:33785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:36171
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:36171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:09.362960 29233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:09.364349 29233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:09.376472 29239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:09.376605 29238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:09.376575 29241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:09.377359 29233 server_base.cc:1034] running on GCE node
I20260619 06:43:09.378252 29233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:09.379703 29233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:09.380937 29233 hybrid_clock.cc:648] HybridClock initialized: now 1781851389380880 us; error 43 us; skew 500 ppm
I20260619 06:43:09.381302 29233 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:09 dist-test-slave-7lz4 krb5kdc[29220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851389, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:09.384459 29233 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:43:09.385996 29233 webserver.cc:460] Webserver started at http://127.10.192.126:43703/ using document root <none> and password file <none>
I20260619 06:43:09.386683 29233 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:09.386814 29233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:09.387148 29233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:09.390244 29233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "baacfad8032c4c6cad068190801f8782"
format_stamp: "Formatted at 2026-06-19 06:43:09 on dist-test-slave-7lz4"
server_key: "9a86edea02fa02593f099add97a1f2ba"
server_key_iv: "a90d1f87ced5349c10ebab8c93b9f655"
server_key_version: "encryptionkey@0"
I20260619 06:43:09.391016 29233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "baacfad8032c4c6cad068190801f8782"
format_stamp: "Formatted at 2026-06-19 06:43:09 on dist-test-slave-7lz4"
server_key: "9a86edea02fa02593f099add97a1f2ba"
server_key_iv: "a90d1f87ced5349c10ebab8c93b9f655"
server_key_version: "encryptionkey@0"
I20260619 06:43:09.396323 29233 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260619 06:43:09.399821 29248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:09.401181 29233 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:43:09.401372 29233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "baacfad8032c4c6cad068190801f8782"
format_stamp: "Formatted at 2026-06-19 06:43:09 on dist-test-slave-7lz4"
server_key: "9a86edea02fa02593f099add97a1f2ba"
server_key_iv: "a90d1f87ced5349c10ebab8c93b9f655"
server_key_version: "encryptionkey@0"
I20260619 06:43:09.401575 29233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:09.425140 29233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:09.429399 29233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:09.429704 29233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:09.448927 29233 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:36171
I20260619 06:43:09.448945 29299 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:36171 every 8 connection(s)
I20260619 06:43:09.450390 29233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:09.454387 29300 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:09.455703 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 29233
I20260619 06:43:09.455901 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:09.456488 11009 external_mini_cluster.cc:1428] Setting key b0acc7c028d028731523b0f7bd8bd890
I20260619 06:43:09.469405 29300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782: Bootstrap starting.
Jun 19 06:43:09 dist-test-slave-7lz4 krb5kdc[29220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:43:09.473399 29300 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:09.474866 29300 log.cc:824] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:09.478489 29300 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782: No bootstrap required, opened a new log
I20260619 06:43:09.481673 29303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:09.458549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49608 (local address 127.10.192.126:36171)
0619 06:43:09.459405 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:09.459417 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:09.459460 (+ 43us) server_negotiation.cc:407] Connection header received
0619 06:43:09.461220 (+ 1760us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:09.461246 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:09.461678 (+ 432us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:09.462040 (+ 362us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:09.463889 (+ 1849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:09.465214 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:09.467127 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:09.467886 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:09.468023 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:09.472927 (+ 4904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:09.472948 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:09.472970 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:09.473024 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:09.476881 (+ 3857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:09.477642 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:09.477651 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:09.477660 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:09.477877 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:09.478276 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:09.478280 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:09.478283 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:09.479046 (+ 763us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:09.479369 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:09.479723 (+ 354us) server_negotiation.cc:299] Negotiation successful
0619 06:43:09.480186 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":410,"threads_started":1}
I20260619 06:43:09.487867 29300 raft_consensus.cc:348] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baacfad8032c4c6cad068190801f8782" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 36171 } }
I20260619 06:43:09.488276 29300 raft_consensus.cc:374] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:09.488399 29300 raft_consensus.cc:729] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baacfad8032c4c6cad068190801f8782, State: Initialized, Role: FOLLOWER
I20260619 06:43:09.488991 29300 consensus_queue.cc:260] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baacfad8032c4c6cad068190801f8782" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 36171 } }
I20260619 06:43:09.489259 29300 raft_consensus.cc:388] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:09.489410 29300 raft_consensus.cc:482] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:09.489586 29300 raft_consensus.cc:3037] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:09.491878 29300 raft_consensus.cc:504] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baacfad8032c4c6cad068190801f8782" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 36171 } }
I20260619 06:43:09.492389 29300 leader_election.cc:302] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: baacfad8032c4c6cad068190801f8782; no voters:
I20260619 06:43:09.493078 29300 leader_election.cc:288] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:09.493220 29305 raft_consensus.cc:2781] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:09.494117 29305 raft_consensus.cc:686] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782 [term 1 LEADER]: Becoming Leader. State: Replica: baacfad8032c4c6cad068190801f8782, State: Running, Role: LEADER
I20260619 06:43:09.494643 29305 consensus_queue.cc:237] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baacfad8032c4c6cad068190801f8782" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 36171 } }
I20260619 06:43:09.495318 29300 sys_catalog.cc:564] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:09.497978 29306 sys_catalog.cc:455] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "baacfad8032c4c6cad068190801f8782" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baacfad8032c4c6cad068190801f8782" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 36171 } } }
I20260619 06:43:09.497994 29307 sys_catalog.cc:455] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782 [sys.catalog]: SysCatalogTable state changed. Reason: New leader baacfad8032c4c6cad068190801f8782. Latest consensus state: current_term: 1 leader_uuid: "baacfad8032c4c6cad068190801f8782" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baacfad8032c4c6cad068190801f8782" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 36171 } } }
I20260619 06:43:09.498545 29307 sys_catalog.cc:458] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:09.499254 29306 sys_catalog.cc:458] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:09.500254 29314 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:09.505589 29314 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:09.519266 29314 catalog_manager.cc:1347] Generated new cluster ID: 9380216bcd584326a3caa254af8e2eb1
I20260619 06:43:09.519392 29314 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:09.540897 29314 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:09.542304 29314 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:09.554700 29314 catalog_manager.cc:5868] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782: Generated new TSK 0
I20260619 06:43:09.555881 29314 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
I20260619 06:43:09.631573 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:36171
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:33785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:09.985042 29326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:09.985320 29326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:09.985417 29326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:09.992991 29326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:09.993108 29326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:09.993230 29326 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:43:10.003597 29326 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:33785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:36171
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:10.005016 29326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:10.006505 29326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:10.019681 29331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:10.019814 29334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:10.020064 29332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:10.020923 29326 server_base.cc:1034] running on GCE node
I20260619 06:43:10.021610 29326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:10.022584 29326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:10.023808 29326 hybrid_clock.cc:648] HybridClock initialized: now 1781851390023745 us; error 57 us; skew 500 ppm
I20260619 06:43:10.024132 29326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:10 dist-test-slave-7lz4 krb5kdc[29220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851390, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:10.027387 29326 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:43:10.028900 29326 webserver.cc:460] Webserver started at http://127.10.192.65:38741/ using document root <none> and password file <none>
I20260619 06:43:10.029613 29326 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:10.029762 29326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:10.030083 29326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:10.033134 29326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "847d9c03aab34b98a8e72808c37f2342"
format_stamp: "Formatted at 2026-06-19 06:43:10 on dist-test-slave-7lz4"
server_key: "81f22fd2ecbd262d455265dc277d97e4"
server_key_iv: "2bc9857073c5b22f3f6f5d3e5eadac88"
server_key_version: "encryptionkey@0"
I20260619 06:43:10.033922 29326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "847d9c03aab34b98a8e72808c37f2342"
format_stamp: "Formatted at 2026-06-19 06:43:10 on dist-test-slave-7lz4"
server_key: "81f22fd2ecbd262d455265dc277d97e4"
server_key_iv: "2bc9857073c5b22f3f6f5d3e5eadac88"
server_key_version: "encryptionkey@0"
I20260619 06:43:10.039417 29326 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260619 06:43:10.043057 29341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:10.044485 29326 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:43:10.044667 29326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "847d9c03aab34b98a8e72808c37f2342"
format_stamp: "Formatted at 2026-06-19 06:43:10 on dist-test-slave-7lz4"
server_key: "81f22fd2ecbd262d455265dc277d97e4"
server_key_iv: "2bc9857073c5b22f3f6f5d3e5eadac88"
server_key_version: "encryptionkey@0"
I20260619 06:43:10.044873 29326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:10.072268 29326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:10.076792 29326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:10.077131 29326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:10.078148 29326 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:43:10.079563 29326 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:43:10.079687 29326 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260619 06:43:10.079845 29326 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:43:10.079919 29326 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:10.114691 29326 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:42731
I20260619 06:43:10.114739 29453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:42731 every 8 connection(s)
I20260619 06:43:10.116048 29326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:43:10.123567 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 29326
I20260619 06:43:10.123802 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:43:10.124323 11009 external_mini_cluster.cc:1428] Setting key abd805f8c6970c076f784ff60d57bdce
Jun 19 06:43:10 dist-test-slave-7lz4 krb5kdc[29220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851390, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:43:10.138989 29456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:10.118940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:43319 (local address 127.10.192.126:36171)
0619 06:43:10.119424 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:10.119430 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:10.120471 (+ 1041us) server_negotiation.cc:407] Connection header received
0619 06:43:10.122411 (+ 1940us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:10.122415 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:10.122484 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:10.122579 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:10.124301 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:10.125291 (+ 990us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:10.127314 (+ 2023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:10.128147 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:10.128298 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:10.131860 (+ 3562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:10.131869 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:10.131877 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:10.131924 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:10.135219 (+ 3295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:10.136326 (+ 1107us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:10.136330 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:10.136332 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:10.136477 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:10.137032 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:10.137039 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:10.137045 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:10.137403 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:10.137554 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:10.138512 (+ 958us) server_negotiation.cc:299] Negotiation successful
0619 06:43:10.138690 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":356,"thread_start_us":237,"threads_started":1}
I20260619 06:43:10.140712 29457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:10.119537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:36171 (local address 127.10.192.65:43319)
0619 06:43:10.120277 (+ 740us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:10.120323 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:10.122152 (+ 1829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:10.122828 (+ 676us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:10.122836 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:10.123381 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:43:10.124122 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:10.124142 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:10.125504 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:10.125509 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:10.127158 (+ 1649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:10.127175 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:10.128370 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:10.128375 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:10.128577 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:10.129288 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:43:10.129311 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:43:10.131563 (+ 2252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:43:10.135391 (+ 3828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:10.135402 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:10.135423 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:10.136180 (+ 757us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:10.136592 (+ 412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:10.136600 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:10.136607 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:10.136878 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:10.137569 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:43:10.137581 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:43:10.138057 (+ 476us) client_negotiation.cc:769] Sending connection context
0619 06:43:10.138421 (+ 364us) client_negotiation.cc:240] Negotiation successful
0619 06:43:10.139079 (+ 658us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":276,"threads_started":1}
I20260619 06:43:10.142493 29454 heartbeater.cc:347] Connected to a master server at 127.10.192.126:36171
I20260619 06:43:10.142817 29454 heartbeater.cc:464] Registering TS with master...
I20260619 06:43:10.143560 29454 heartbeater.cc:511] Master 127.10.192.126:36171 requested a full tablet report, sending...
I20260619 06:43:10.146129 29265 ts_manager.cc:194] Registered new tserver with Master: 847d9c03aab34b98a8e72808c37f2342 (127.10.192.65:42731)
I20260619 06:43:10.148607 29265 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:43319
WARNING: no policy specified for kudu/127.10.192.66@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
I20260619 06:43:10.183284 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:36171
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:33785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:10.512188 29460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:10.512461 29460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:10.512555 29460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:10.520512 29460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:10.520625 29460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:10.520740 29460 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:43:10.530704 29460 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:33785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:36171
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:10.532049 29460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:10.533329 29460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:10.546559 29465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:10.546559 29466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:10.546895 29468 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:10.547381 29460 server_base.cc:1034] running on GCE node
I20260619 06:43:10.548108 29460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:10.549185 29460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:10.550395 29460 hybrid_clock.cc:648] HybridClock initialized: now 1781851390550333 us; error 55 us; skew 500 ppm
I20260619 06:43:10.550721 29460 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:10 dist-test-slave-7lz4 krb5kdc[29220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851390, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:10.559139 29460 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:43:10.560691 29460 webserver.cc:460] Webserver started at http://127.10.192.66:39961/ using document root <none> and password file <none>
I20260619 06:43:10.561416 29460 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:10.561563 29460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:10.561882 29460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:10.564915 29460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "4bf1d6b9099b4dd993609633fda0452b"
format_stamp: "Formatted at 2026-06-19 06:43:10 on dist-test-slave-7lz4"
server_key: "8bce5b4efba3df6445d7146b2a55c4c3"
server_key_iv: "3534bc8eb197aed93d21ecd94c95483d"
server_key_version: "encryptionkey@0"
I20260619 06:43:10.565688 29460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "4bf1d6b9099b4dd993609633fda0452b"
format_stamp: "Formatted at 2026-06-19 06:43:10 on dist-test-slave-7lz4"
server_key: "8bce5b4efba3df6445d7146b2a55c4c3"
server_key_iv: "3534bc8eb197aed93d21ecd94c95483d"
server_key_version: "encryptionkey@0"
I20260619 06:43:10.571046 29460 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260619 06:43:10.574587 29475 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:10.575995 29460 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260619 06:43:10.576174 29460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "4bf1d6b9099b4dd993609633fda0452b"
format_stamp: "Formatted at 2026-06-19 06:43:10 on dist-test-slave-7lz4"
server_key: "8bce5b4efba3df6445d7146b2a55c4c3"
server_key_iv: "3534bc8eb197aed93d21ecd94c95483d"
server_key_version: "encryptionkey@0"
I20260619 06:43:10.576387 29460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:10.597966 29460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:10.602301 29460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:10.602598 29460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:10.603608 29460 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:43:10.605149 29460 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:43:10.605252 29460 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:10.605389 29460 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:43:10.605482 29460 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:10.639258 29460 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:43431
I20260619 06:43:10.639318 29587 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:43431 every 8 connection(s)
I20260619 06:43:10.640746 29460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:43:10.648339 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 29460
I20260619 06:43:10.648530 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:43:10.649132 11009 external_mini_cluster.cc:1428] Setting key a1e47164d189f54e6ffd3e41007feee9
Jun 19 06:43:10 dist-test-slave-7lz4 krb5kdc[29220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851390, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:43:10.663179 29590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:10.643414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:48549 (local address 127.10.192.126:36171)
0619 06:43:10.643908 (+ 494us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:10.643913 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:10.644927 (+ 1014us) server_negotiation.cc:407] Connection header received
0619 06:43:10.646806 (+ 1879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:10.646812 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:10.646915 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:10.647036 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:10.648816 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:10.649916 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:10.652131 (+ 2215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:10.652672 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:10.652818 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:10.656653 (+ 3835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:10.656658 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:10.656661 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:10.656696 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:10.659543 (+ 2847us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:10.660486 (+ 943us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:10.660498 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:10.660500 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:10.660647 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:10.661169 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:10.661174 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:10.661176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:10.661474 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:10.661649 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:10.662463 (+ 814us) server_negotiation.cc:299] Negotiation successful
0619 06:43:10.662716 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":273,"threads_started":1}
I20260619 06:43:10.664367 29591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:10.644008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:36171 (local address 127.10.192.66:48549)
0619 06:43:10.644719 (+ 711us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:10.644762 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:10.646517 (+ 1755us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:10.647291 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:10.647299 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:10.647918 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:43:10.648586 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:10.648621 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:10.650106 (+ 1485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:10.650110 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:10.651922 (+ 1812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:10.651935 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:10.652903 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:10.652913 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:10.653155 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:10.653874 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:43:10.653898 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:43:10.656381 (+ 2483us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:43:10.659791 (+ 3410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:10.659802 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:10.659823 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:10.660320 (+ 497us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:10.660799 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:10.660805 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:10.660809 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:10.661026 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:10.661625 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:43:10.661635 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:43:10.662039 (+ 404us) client_negotiation.cc:769] Sending connection context
0619 06:43:10.662344 (+ 305us) client_negotiation.cc:240] Negotiation successful
0619 06:43:10.662945 (+ 601us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":270,"threads_started":1}
I20260619 06:43:10.666028 29588 heartbeater.cc:347] Connected to a master server at 127.10.192.126:36171
I20260619 06:43:10.666390 29588 heartbeater.cc:464] Registering TS with master...
I20260619 06:43:10.667169 29588 heartbeater.cc:511] Master 127.10.192.126:36171 requested a full tablet report, sending...
I20260619 06:43:10.668871 29265 ts_manager.cc:194] Registered new tserver with Master: 4bf1d6b9099b4dd993609633fda0452b (127.10.192.66:43431)
I20260619 06:43:10.669739 29265 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:48549
WARNING: no policy specified for kudu/127.10.192.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
I20260619 06:43:10.705834 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:36171
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:33785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:11.039475 29594 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:11.039877 29594 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:11.040060 29594 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:11.047477 29594 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:11.047679 29594 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:11.047868 29594 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:43:11.057730 29594 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:33785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:36171
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:11.059118 29594 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:11.060499 29594 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:11.074079 29602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:11.074107 29600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:11.074368 29599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:11.075148 29594 server_base.cc:1034] running on GCE node
I20260619 06:43:11.075938 29594 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:11.076943 29594 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:11.078156 29594 hybrid_clock.cc:648] HybridClock initialized: now 1781851391078105 us; error 45 us; skew 500 ppm
I20260619 06:43:11.078528 29594 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:11 dist-test-slave-7lz4 krb5kdc[29220](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851391, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:11.082034 29594 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:43:11.083593 29594 webserver.cc:460] Webserver started at http://127.10.192.67:41197/ using document root <none> and password file <none>
I20260619 06:43:11.084379 29594 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:11.084512 29594 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:11.084838 29594 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:11.087917 29594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "0c119cfb15c742f88d5c2fb8eeecc216"
format_stamp: "Formatted at 2026-06-19 06:43:11 on dist-test-slave-7lz4"
server_key: "43f19f851dc5c9bf89a1d3de74b65c45"
server_key_iv: "437e515ad3c5c9e2845887e05fd84254"
server_key_version: "encryptionkey@0"
I20260619 06:43:11.088711 29594 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "0c119cfb15c742f88d5c2fb8eeecc216"
format_stamp: "Formatted at 2026-06-19 06:43:11 on dist-test-slave-7lz4"
server_key: "43f19f851dc5c9bf89a1d3de74b65c45"
server_key_iv: "437e515ad3c5c9e2845887e05fd84254"
server_key_version: "encryptionkey@0"
I20260619 06:43:11.094144 29594 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260619 06:43:11.098026 29609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:11.099494 29594 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 06:43:11.099711 29594 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "0c119cfb15c742f88d5c2fb8eeecc216"
format_stamp: "Formatted at 2026-06-19 06:43:11 on dist-test-slave-7lz4"
server_key: "43f19f851dc5c9bf89a1d3de74b65c45"
server_key_iv: "437e515ad3c5c9e2845887e05fd84254"
server_key_version: "encryptionkey@0"
I20260619 06:43:11.099931 29594 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:11.127897 29594 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:11.132470 29594 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:11.132773 29594 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:11.133759 29594 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:43:11.135121 29594 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:43:11.135195 29594 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:11.135393 29594 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:43:11.135452 29594 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:11.152031 29454 heartbeater.cc:503] Master 127.10.192.126:36171 was elected leader, sending a full tablet report...
I20260619 06:43:11.170004 29594 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:43547
I20260619 06:43:11.170060 29721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:43547 every 8 connection(s)
I20260619 06:43:11.171380 29594 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:43:11.173130 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 29594
I20260619 06:43:11.173346 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:43:11.173971 11009 external_mini_cluster.cc:1428] Setting key 69dbb5af37efe395a38bf9f45e9c766f
Jun 19 06:43:11 dist-test-slave-7lz4 krb5kdc[29220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851391, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:43:11.193501 29724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:11.174546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:39095 (local address 127.10.192.126:36171)
0619 06:43:11.175479 (+ 933us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:11.175488 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:11.176359 (+ 871us) server_negotiation.cc:407] Connection header received
0619 06:43:11.178626 (+ 2267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:11.178630 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:11.178715 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:11.178841 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:11.180698 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.181605 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.183265 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.183727 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.183824 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:11.187280 (+ 3456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:11.187285 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:11.187288 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:11.187331 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:11.190679 (+ 3348us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:11.191371 (+ 692us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:11.191374 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:11.191377 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:11.191491 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:11.191953 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:11.191956 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:11.191958 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:11.192238 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:11.192372 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:11.193049 (+ 677us) server_negotiation.cc:299] Negotiation successful
0619 06:43:11.193220 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":795,"thread_start_us":686,"threads_started":1}
I20260619 06:43:11.194540 29725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:11.175111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:36171 (local address 127.10.192.67:39095)
0619 06:43:11.176159 (+ 1048us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:11.176220 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:11.178353 (+ 2133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:11.179044 (+ 691us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:11.179053 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:11.179783 (+ 730us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:43:11.180488 (+ 705us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:11.180509 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.181765 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.181770 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:11.183114 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:11.183128 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.183937 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.183942 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:11.184147 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:11.184876 (+ 729us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:43:11.184900 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:43:11.187081 (+ 2181us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:43:11.190807 (+ 3726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:11.190814 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:11.190827 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:11.191270 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:11.191582 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:11.191585 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:11.191587 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:11.191828 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:11.192358 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:43:11.192363 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:43:11.192708 (+ 345us) client_negotiation.cc:769] Sending connection context
0619 06:43:11.192949 (+ 241us) client_negotiation.cc:240] Negotiation successful
0619 06:43:11.193348 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":707,"thread_start_us":455,"threads_started":1}
I20260619 06:43:11.196226 29722 heartbeater.cc:347] Connected to a master server at 127.10.192.126:36171
I20260619 06:43:11.196554 29722 heartbeater.cc:464] Registering TS with master...
I20260619 06:43:11.197284 29722 heartbeater.cc:511] Master 127.10.192.126:36171 requested a full tablet report, sending...
I20260619 06:43:11.198779 29265 ts_manager.cc:194] Registered new tserver with Master: 0c119cfb15c742f88d5c2fb8eeecc216 (127.10.192.67:43547)
I20260619 06:43:11.199702 29265 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:39095
I20260619 06:43:11.202612 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 06:43:11.220309 29724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:11.206688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49616 (local address 127.10.192.126:36171)
0619 06:43:11.206850 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:11.206854 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:11.207399 (+ 545us) server_negotiation.cc:407] Connection header received
0619 06:43:11.207516 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:11.207520 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:11.207588 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:11.207762 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:11.209071 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.209888 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.211170 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.211601 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.211782 (+ 181us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:11.214397 (+ 2615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:11.214402 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:11.214405 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:11.214446 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:11.217224 (+ 2778us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:11.217991 (+ 767us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:11.217995 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:11.217997 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:11.218115 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:11.218586 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:11.218589 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:11.218591 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:11.218885 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:11.219071 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:11.219589 (+ 518us) server_negotiation.cc:299] Negotiation successful
0619 06:43:11.219857 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260619 06:43:11.224313 29265 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49616:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:43:11.231353 29265 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:43:11.257463 29736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:11.244697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:43431 (local address 127.0.0.1:37268)
0619 06:43:11.245630 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:11.245667 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:11.245838 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:11.249053 (+ 3215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:11.249063 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:11.249093 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:11.249622 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:11.249636 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.251593 (+ 1957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.251598 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:11.254193 (+ 2595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:11.254208 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.256371 (+ 2163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.256377 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:11.256593 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:11.256650 (+ 57us) client_negotiation.cc:769] Sending connection context
0619 06:43:11.256798 (+ 148us) client_negotiation.cc:240] Negotiation successful
0619 06:43:11.256991 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"mutex_wait_us":1,"thread_start_us":2415,"threads_started":1}
I20260619 06:43:11.258411 29737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:11.244808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37268 (local address 127.10.192.66:43431)
0619 06:43:11.248101 (+ 3293us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:11.248113 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:11.248143 (+ 30us) server_negotiation.cc:407] Connection header received
0619 06:43:11.248245 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:11.248252 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:11.248581 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:11.248792 (+ 211us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:11.249810 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.251432 (+ 1622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.254382 (+ 2950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.255895 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.256025 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:11.256227 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:11.257896 (+ 1669us) server_negotiation.cc:299] Negotiation successful
0619 06:43:11.258078 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3107,"thread_start_us":2989,"threads_started":1}
I20260619 06:43:11.258950 29735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:11.244845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:43547 (local address 127.0.0.1:56942)
0619 06:43:11.247317 (+ 2472us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:11.247330 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:11.247481 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:11.248613 (+ 1132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:11.248621 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:11.248652 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:11.249157 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:11.249171 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.252608 (+ 3437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.252613 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:11.254776 (+ 2163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:11.254790 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.258118 (+ 3328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.258124 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:11.258321 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:11.258356 (+ 35us) client_negotiation.cc:769] Sending connection context
0619 06:43:11.258449 (+ 93us) client_negotiation.cc:240] Negotiation successful
0619 06:43:11.258588 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2367,"thread_start_us":325,"threads_started":1}
I20260619 06:43:11.259966 29738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:11.245287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56942 (local address 127.10.192.67:43547)
0619 06:43:11.246950 (+ 1663us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:11.246957 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:11.247443 (+ 486us) server_negotiation.cc:407] Connection header received
0619 06:43:11.247729 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:11.247739 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:11.248078 (+ 339us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:11.248307 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:11.249785 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.251429 (+ 1644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.254958 (+ 3529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.256405 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.256529 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:11.256756 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:11.259399 (+ 2643us) server_negotiation.cc:299] Negotiation successful
0619 06:43:11.259602 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1513,"thread_start_us":1352,"threads_started":1}
I20260619 06:43:11.263955 29657 tablet_service.cc:1467] Processing CreateTablet for tablet 5462725c1ae340048274d8bec2dc6262 (DEFAULT_TABLE table=test-table [id=5b7efc5bcc9e49aab6477739c2f36542]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:43:11.263974 29523 tablet_service.cc:1467] Processing CreateTablet for tablet 5462725c1ae340048274d8bec2dc6262 (DEFAULT_TABLE table=test-table [id=5b7efc5bcc9e49aab6477739c2f36542]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:43:11.265235 29523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5462725c1ae340048274d8bec2dc6262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:11.265332 29657 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5462725c1ae340048274d8bec2dc6262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:11.267190 29736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:11.248157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:42731 (local address 127.0.0.1:58614)
0619 06:43:11.259179 (+ 11022us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:11.259199 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:11.259295 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:11.260636 (+ 1341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:11.260641 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:11.260670 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:11.260827 (+ 157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:11.260836 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.262707 (+ 1871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.262712 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:11.264565 (+ 1853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:11.264580 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.266390 (+ 1810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.266396 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:11.266598 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:11.266632 (+ 34us) client_negotiation.cc:769] Sending connection context
0619 06:43:11.266731 (+ 99us) client_negotiation.cc:240] Negotiation successful
0619 06:43:11.266879 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10747,"thread_start_us":11990,"threads_started":1}
I20260619 06:43:11.267293 29739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:11.248003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58614 (local address 127.10.192.65:42731)
0619 06:43:11.259934 (+ 11931us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:11.259947 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:11.259980 (+ 33us) server_negotiation.cc:407] Connection header received
0619 06:43:11.260091 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:11.260099 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:11.260401 (+ 302us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:11.260630 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:11.260980 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.262554 (+ 1574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.264743 (+ 2189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.266206 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.266361 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:11.266582 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:11.266801 (+ 219us) server_negotiation.cc:299] Negotiation successful
0619 06:43:11.266971 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11737,"thread_start_us":11540,"threads_started":1}
I20260619 06:43:11.272349 29389 tablet_service.cc:1467] Processing CreateTablet for tablet 5462725c1ae340048274d8bec2dc6262 (DEFAULT_TABLE table=test-table [id=5b7efc5bcc9e49aab6477739c2f36542]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:43:11.273896 29389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5462725c1ae340048274d8bec2dc6262. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:11.277532 29741 tablet_bootstrap.cc:492] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216: Bootstrap starting.
I20260619 06:43:11.279652 29742 tablet_bootstrap.cc:492] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b: Bootstrap starting.
I20260619 06:43:11.281392 29741 tablet_bootstrap.cc:654] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:11.282805 29741 log.cc:824] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:11.283984 29742 tablet_bootstrap.cc:654] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:11.285255 29742 log.cc:824] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:11.286157 29741 tablet_bootstrap.cc:492] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216: No bootstrap required, opened a new log
I20260619 06:43:11.286444 29741 ts_tablet_manager.cc:1397] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.000s
I20260619 06:43:11.288391 29745 tablet_bootstrap.cc:492] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342: Bootstrap starting.
I20260619 06:43:11.288481 29742 tablet_bootstrap.cc:492] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b: No bootstrap required, opened a new log
I20260619 06:43:11.288893 29742 ts_tablet_manager.cc:1397] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.005s
I20260619 06:43:11.291785 29745 tablet_bootstrap.cc:654] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:11.292842 29745 log.cc:824] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:11.295608 29745 tablet_bootstrap.cc:492] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342: No bootstrap required, opened a new log
I20260619 06:43:11.295951 29745 ts_tablet_manager.cc:1397] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260619 06:43:11.297869 29741 raft_consensus.cc:348] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf1d6b9099b4dd993609633fda0452b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 43431 } } peers { permanent_uuid: "0c119cfb15c742f88d5c2fb8eeecc216" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43547 } } peers { permanent_uuid: "847d9c03aab34b98a8e72808c37f2342" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42731 } }
I20260619 06:43:11.298384 29741 raft_consensus.cc:374] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:11.298522 29741 raft_consensus.cc:729] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c119cfb15c742f88d5c2fb8eeecc216, State: Initialized, Role: FOLLOWER
I20260619 06:43:11.299212 29741 consensus_queue.cc:260] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf1d6b9099b4dd993609633fda0452b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 43431 } } peers { permanent_uuid: "0c119cfb15c742f88d5c2fb8eeecc216" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43547 } } peers { permanent_uuid: "847d9c03aab34b98a8e72808c37f2342" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42731 } }
I20260619 06:43:11.299582 29742 raft_consensus.cc:348] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf1d6b9099b4dd993609633fda0452b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 43431 } } peers { permanent_uuid: "0c119cfb15c742f88d5c2fb8eeecc216" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43547 } } peers { permanent_uuid: "847d9c03aab34b98a8e72808c37f2342" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42731 } }
I20260619 06:43:11.300107 29742 raft_consensus.cc:374] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:11.300238 29742 raft_consensus.cc:729] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bf1d6b9099b4dd993609633fda0452b, State: Initialized, Role: FOLLOWER
I20260619 06:43:11.300402 29722 heartbeater.cc:503] Master 127.10.192.126:36171 was elected leader, sending a full tablet report...
I20260619 06:43:11.301141 29741 ts_tablet_manager.cc:1428] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216: Time spent starting tablet: real 0.015s user 0.014s sys 0.001s
I20260619 06:43:11.301034 29742 consensus_queue.cc:260] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf1d6b9099b4dd993609633fda0452b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 43431 } } peers { permanent_uuid: "0c119cfb15c742f88d5c2fb8eeecc216" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43547 } } peers { permanent_uuid: "847d9c03aab34b98a8e72808c37f2342" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42731 } }
I20260619 06:43:11.302577 29588 heartbeater.cc:503] Master 127.10.192.126:36171 was elected leader, sending a full tablet report...
I20260619 06:43:11.303372 29742 ts_tablet_manager.cc:1428] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b: Time spent starting tablet: real 0.014s user 0.011s sys 0.002s
I20260619 06:43:11.305440 29745 raft_consensus.cc:348] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf1d6b9099b4dd993609633fda0452b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 43431 } } peers { permanent_uuid: "0c119cfb15c742f88d5c2fb8eeecc216" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43547 } } peers { permanent_uuid: "847d9c03aab34b98a8e72808c37f2342" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42731 } }
I20260619 06:43:11.306006 29745 raft_consensus.cc:374] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:11.306155 29745 raft_consensus.cc:729] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 847d9c03aab34b98a8e72808c37f2342, State: Initialized, Role: FOLLOWER
I20260619 06:43:11.306782 29745 consensus_queue.cc:260] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf1d6b9099b4dd993609633fda0452b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 43431 } } peers { permanent_uuid: "0c119cfb15c742f88d5c2fb8eeecc216" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43547 } } peers { permanent_uuid: "847d9c03aab34b98a8e72808c37f2342" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42731 } }
I20260619 06:43:11.308681 29745 ts_tablet_manager.cc:1428] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342: Time spent starting tablet: real 0.013s user 0.012s sys 0.000s
W20260619 06:43:11.368546 29455 tablet.cc:2369] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 06:43:11.392851 29589 tablet.cc:2369] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260619 06:43:11.423277 29723 tablet.cc:2369] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:43:11.463745 29747 raft_consensus.cc:482] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:43:11.464138 29747 raft_consensus.cc:504] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf1d6b9099b4dd993609633fda0452b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 43431 } } peers { permanent_uuid: "0c119cfb15c742f88d5c2fb8eeecc216" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43547 } } peers { permanent_uuid: "847d9c03aab34b98a8e72808c37f2342" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42731 } }
I20260619 06:43:11.465878 29747 leader_election.cc:288] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4bf1d6b9099b4dd993609633fda0452b (127.10.192.66:43431), 847d9c03aab34b98a8e72808c37f2342 (127.10.192.65:42731)
I20260619 06:43:11.472631 29737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:11.466426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:47555 (local address 127.10.192.66:43431)
0619 06:43:11.466632 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:11.466640 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:11.466738 (+ 98us) server_negotiation.cc:407] Connection header received
0619 06:43:11.467030 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:11.467038 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:11.467136 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:11.467255 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:11.467861 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.468845 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.470683 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.471837 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.471964 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:11.472017 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:11.472349 (+ 332us) server_negotiation.cc:299] Negotiation successful
0619 06:43:11.472440 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 06:43:11.472795 29725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:11.466382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:43431 (local address 127.10.192.67:47555)
0619 06:43:11.466625 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:11.466645 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:11.466827 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:11.467427 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:11.467433 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:11.467467 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:11.467711 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:11.467724 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.468982 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.468988 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:11.470524 (+ 1536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:11.470536 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.471978 (+ 1442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.471985 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:11.472177 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:11.472212 (+ 35us) client_negotiation.cc:769] Sending connection context
0619 06:43:11.472327 (+ 115us) client_negotiation.cc:240] Negotiation successful
0619 06:43:11.472465 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67,"mutex_wait_us":3}
I20260619 06:43:11.473557 29750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:11.466799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:42731 (local address 127.10.192.67:53215)
0619 06:43:11.467528 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:11.467544 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:11.467691 (+ 147us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:11.468052 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:11.468055 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:11.468074 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:11.468361 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:11.468369 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.469675 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.469679 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:11.471341 (+ 1662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:11.471357 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.472828 (+ 1471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.472836 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:11.473008 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:11.473042 (+ 34us) client_negotiation.cc:769] Sending connection context
0619 06:43:11.473158 (+ 116us) client_negotiation.cc:240] Negotiation successful
0619 06:43:11.473280 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"thread_start_us":413,"threads_started":1}
I20260619 06:43:11.473554 29739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:11.467075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:53215 (local address 127.10.192.65:42731)
0619 06:43:11.467317 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:11.467324 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:11.467670 (+ 346us) server_negotiation.cc:407] Connection header received
0619 06:43:11.467837 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:11.467842 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:11.467922 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:11.468036 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:11.468520 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.469520 (+ 1000us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.471499 (+ 1979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.472604 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.472756 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:11.472851 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:11.473201 (+ 350us) server_negotiation.cc:299] Negotiation successful
0619 06:43:11.473309 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260619 06:43:11.473939 29543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5462725c1ae340048274d8bec2dc6262" candidate_uuid: "0c119cfb15c742f88d5c2fb8eeecc216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bf1d6b9099b4dd993609633fda0452b" is_pre_election: true
I20260619 06:43:11.474550 29543 raft_consensus.cc:2454] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c119cfb15c742f88d5c2fb8eeecc216 in term 0.
I20260619 06:43:11.474640 29409 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5462725c1ae340048274d8bec2dc6262" candidate_uuid: "0c119cfb15c742f88d5c2fb8eeecc216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847d9c03aab34b98a8e72808c37f2342" is_pre_election: true
I20260619 06:43:11.475148 29409 raft_consensus.cc:2454] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c119cfb15c742f88d5c2fb8eeecc216 in term 0.
I20260619 06:43:11.475211 29613 leader_election.cc:302] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c119cfb15c742f88d5c2fb8eeecc216, 4bf1d6b9099b4dd993609633fda0452b; no voters:
I20260619 06:43:11.475688 29747 raft_consensus.cc:2781] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:43:11.475852 29747 raft_consensus.cc:482] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:43:11.475992 29747 raft_consensus.cc:3037] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:11.478183 29747 raft_consensus.cc:504] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf1d6b9099b4dd993609633fda0452b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 43431 } } peers { permanent_uuid: "0c119cfb15c742f88d5c2fb8eeecc216" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43547 } } peers { permanent_uuid: "847d9c03aab34b98a8e72808c37f2342" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42731 } }
I20260619 06:43:11.478775 29747 leader_election.cc:288] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [CANDIDATE]: Term 1 election: Requested vote from peers 4bf1d6b9099b4dd993609633fda0452b (127.10.192.66:43431), 847d9c03aab34b98a8e72808c37f2342 (127.10.192.65:42731)
I20260619 06:43:11.479254 29543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5462725c1ae340048274d8bec2dc6262" candidate_uuid: "0c119cfb15c742f88d5c2fb8eeecc216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4bf1d6b9099b4dd993609633fda0452b"
I20260619 06:43:11.479342 29409 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5462725c1ae340048274d8bec2dc6262" candidate_uuid: "0c119cfb15c742f88d5c2fb8eeecc216" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "847d9c03aab34b98a8e72808c37f2342"
I20260619 06:43:11.479504 29543 raft_consensus.cc:3037] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:11.479554 29409 raft_consensus.cc:3037] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:11.482853 29543 raft_consensus.cc:2454] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c119cfb15c742f88d5c2fb8eeecc216 in term 1.
I20260619 06:43:11.482853 29409 raft_consensus.cc:2454] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c119cfb15c742f88d5c2fb8eeecc216 in term 1.
I20260619 06:43:11.483294 29613 leader_election.cc:302] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c119cfb15c742f88d5c2fb8eeecc216, 847d9c03aab34b98a8e72808c37f2342; no voters:
I20260619 06:43:11.483701 29747 raft_consensus.cc:2781] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:11.484223 29747 raft_consensus.cc:686] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [term 1 LEADER]: Becoming Leader. State: Replica: 0c119cfb15c742f88d5c2fb8eeecc216, State: Running, Role: LEADER
I20260619 06:43:11.484762 29747 consensus_queue.cc:237] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf1d6b9099b4dd993609633fda0452b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 43431 } } peers { permanent_uuid: "0c119cfb15c742f88d5c2fb8eeecc216" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43547 } } peers { permanent_uuid: "847d9c03aab34b98a8e72808c37f2342" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42731 } }
I20260619 06:43:11.489646 29264 catalog_manager.cc:5495] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c119cfb15c742f88d5c2fb8eeecc216 (127.10.192.67). New cstate: current_term: 1 leader_uuid: "0c119cfb15c742f88d5c2fb8eeecc216" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4bf1d6b9099b4dd993609633fda0452b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 43431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c119cfb15c742f88d5c2fb8eeecc216" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 43547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "847d9c03aab34b98a8e72808c37f2342" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42731 } health_report { overall_health: UNKNOWN } } }
I20260619 06:43:11.560942 29738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:11.555402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56946 (local address 127.10.192.67:43547)
0619 06:43:11.555665 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:11.555672 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:11.555693 (+ 21us) server_negotiation.cc:407] Connection header received
0619 06:43:11.555814 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:11.555819 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:11.555907 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:11.556061 (+ 154us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:43:11.556439 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.557179 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.558690 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.559094 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.559235 (+ 141us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:11.559830 (+ 595us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:43:11.560329 (+ 499us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:43:11.560517 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:11.560660 (+ 143us) server_negotiation.cc:299] Negotiation successful
0619 06:43:11.560707 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260619 06:43:11.569358 29409 raft_consensus.cc:1261] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342 [term 1 FOLLOWER]: Refusing update from remote peer 0c119cfb15c742f88d5c2fb8eeecc216: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:43:11.569358 29543 raft_consensus.cc:1261] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b [term 1 FOLLOWER]: Refusing update from remote peer 0c119cfb15c742f88d5c2fb8eeecc216: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:43:11.570379 29747 consensus_queue.cc:1035] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "847d9c03aab34b98a8e72808c37f2342" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 42731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:43:11.570719 29751 consensus_queue.cc:1035] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4bf1d6b9099b4dd993609633fda0452b" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 43431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:43:11.597816 29264 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:43:11.598171 29264 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:43:11.601913 29264 catalog_manager.cc:5782] T 00000000000000000000000000000000 P baacfad8032c4c6cad068190801f8782: Sending DeleteTablet for 3 replicas of tablet 5462725c1ae340048274d8bec2dc6262
I20260619 06:43:11.603268 29523 tablet_service.cc:1514] Processing DeleteTablet for tablet 5462725c1ae340048274d8bec2dc6262 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:43:11 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:37268
I20260619 06:43:11.603263 29657 tablet_service.cc:1514] Processing DeleteTablet for tablet 5462725c1ae340048274d8bec2dc6262 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:43:11 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:56942
I20260619 06:43:11.603463 29389 tablet_service.cc:1514] Processing DeleteTablet for tablet 5462725c1ae340048274d8bec2dc6262 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:43:11 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:58614
I20260619 06:43:11.609119 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 29326
I20260619 06:43:11.613595 29765 tablet_replica.cc:330] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342: stopping tablet replica
I20260619 06:43:11.615047 29765 raft_consensus.cc:2229] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:43:11.615197 29764 tablet_replica.cc:330] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216: stopping tablet replica
I20260619 06:43:11.615765 29764 raft_consensus.cc:2229] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:43:11.615985 29766 tablet_replica.cc:330] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b: stopping tablet replica
I20260619 06:43:11.616611 29765 raft_consensus.cc:2258] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:43:11.616621 29764 raft_consensus.cc:2258] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:43:11.617098 29766 raft_consensus.cc:2229] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:43:11.617959 29766 raft_consensus.cc:2258] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:43:11.619328 29764 ts_tablet_manager.cc:1905] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:43:11.621227 29765 ts_tablet_manager.cc:1905] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:43:11.622452 29766 ts_tablet_manager.cc:1905] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:43:11.627218 29764 ts_tablet_manager.cc:1918] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:43:11.627503 29764 log.cc:1196] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/5462725c1ae340048274d8bec2dc6262
I20260619 06:43:11.628214 29764 ts_tablet_manager.cc:1939] T 5462725c1ae340048274d8bec2dc6262 P 0c119cfb15c742f88d5c2fb8eeecc216: Deleting consensus metadata
I20260619 06:43:11.629173 29765 ts_tablet_manager.cc:1918] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:43:11.629719 29766 ts_tablet_manager.cc:1918] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:43:11.629961 29766 log.cc:1196] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/5462725c1ae340048274d8bec2dc6262
I20260619 06:43:11.630381 29250 catalog_manager.cc:4841] TS 0c119cfb15c742f88d5c2fb8eeecc216 (127.10.192.67:43547): tablet 5462725c1ae340048274d8bec2dc6262 (table test-table [id=5b7efc5bcc9e49aab6477739c2f36542]) successfully deleted
I20260619 06:43:11.630617 29766 ts_tablet_manager.cc:1939] T 5462725c1ae340048274d8bec2dc6262 P 4bf1d6b9099b4dd993609633fda0452b: Deleting consensus metadata
I20260619 06:43:11.632357 29252 catalog_manager.cc:4841] TS 4bf1d6b9099b4dd993609633fda0452b (127.10.192.66:43431): tablet 5462725c1ae340048274d8bec2dc6262 (table test-table [id=5b7efc5bcc9e49aab6477739c2f36542]) successfully deleted
I20260619 06:43:11.632696 29765 log.cc:1196] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/5462725c1ae340048274d8bec2dc6262
Jun 19 06:43:11 dist-test-slave-7lz4 krb5kdc[29220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:43:11.633198 29765 ts_tablet_manager.cc:1939] T 5462725c1ae340048274d8bec2dc6262 P 847d9c03aab34b98a8e72808c37f2342: Deleting consensus metadata
I20260619 06:43:11.634956 29252 catalog_manager.cc:4841] TS 847d9c03aab34b98a8e72808c37f2342 (127.10.192.65:42731): tablet 5462725c1ae340048274d8bec2dc6262 (table test-table [id=5b7efc5bcc9e49aab6477739c2f36542]) successfully deleted
I20260619 06:43:11.641254 29739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:11.610337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58622 (local address 127.10.192.65:42731)
0619 06:43:11.610552 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:11.610558 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:11.613143 (+ 2585us) server_negotiation.cc:407] Connection header received
0619 06:43:11.613239 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:11.613245 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:11.613364 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:11.613484 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:11.616826 (+ 3342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.618088 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.620108 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.620777 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.620879 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:11.634234 (+ 13355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:11.634247 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:11.634264 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:11.634313 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:11.637689 (+ 3376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:11.638723 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:11.638733 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:11.638737 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:11.638927 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:11.639404 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:11.639409 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:11.639412 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:11.639929 (+ 517us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:11.640235 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:11.640640 (+ 405us) server_negotiation.cc:299] Negotiation successful
0619 06:43:11.640880 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260619 06:43:11.642122 29449 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:11.750406 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 29326
I20260619 06:43:11.768528 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 29460
Jun 19 06:43:11 dist-test-slave-7lz4 krb5kdc[29220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.66@KRBTEST.COM
I20260619 06:43:11.786162 29737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:11.769423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37274 (local address 127.10.192.66:43431)
0619 06:43:11.769621 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:11.769628 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:11.769649 (+ 21us) server_negotiation.cc:407] Connection header received
0619 06:43:11.769718 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:11.769722 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:11.769794 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:11.769909 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:11.771180 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.772335 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.773610 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.774252 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.774396 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:11.778901 (+ 4505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:11.778922 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:11.778944 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:11.778991 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:11.782947 (+ 3956us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:11.783943 (+ 996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:11.783951 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:11.783953 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:11.784083 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:11.784523 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:11.784526 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:11.784528 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:11.784922 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:11.785234 (+ 312us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:11.785572 (+ 338us) server_negotiation.cc:299] Negotiation successful
0619 06:43:11.785795 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260619 06:43:11.786962 29583 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:11.879663 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 29460
I20260619 06:43:11.898975 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 29594
Jun 19 06:43:11 dist-test-slave-7lz4 krb5kdc[29220](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.67@KRBTEST.COM
I20260619 06:43:11.917548 29738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:11.900181 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56954 (local address 127.10.192.67:43547)
0619 06:43:11.900346 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:11.900350 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:11.900370 (+ 20us) server_negotiation.cc:407] Connection header received
0619 06:43:11.900434 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:11.900438 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:11.900511 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:11.900659 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:11.902161 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.903090 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.904627 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:11.905209 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:11.905364 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:11.910724 (+ 5360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:11.910740 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:11.910759 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:11.910806 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:11.914256 (+ 3450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:11.915082 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:11.915090 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:11.915093 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:11.915293 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:11.915768 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:11.915772 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:11.915775 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:11.916179 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:11.916559 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:11.916852 (+ 293us) server_negotiation.cc:299] Negotiation successful
0619 06:43:11.917094 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260619 06:43:11.918447 29717 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:12.044387 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 29594
I20260619 06:43:12.063745 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 29233
I20260619 06:43:12.064990 29295 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:12.177484 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 29233
2026-06-19T06:43:12Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4532 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-06-19T06:43:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:12Z Disabled control of system clock
I20260619 06:43:12.256057 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:45317
--webserver_interface=127.10.192.126
--webserver_port=0
--builtin_ntp_servers=127.10.192.84:44703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:45317
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260619 06:43:12.595803 29775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:12.596127 29775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:12.596210 29775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:12.603610 29775 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:12.603799 29775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:12.603902 29775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:12.604020 29775 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:12.604099 29775 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:12.613624 29775 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:44703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:45317
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:45317
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:12.615000 29775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:12.617082 29775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:12.629552 29781 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:12.629583 29783 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:12.629743 29780 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:12.630537 29775 server_base.cc:1034] running on GCE node
I20260619 06:43:12.631440 29775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:12.633036 29775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:12.634269 29775 hybrid_clock.cc:648] HybridClock initialized: now 1781851392634213 us; error 51 us; skew 500 ppm
I20260619 06:43:12.634655 29775 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:43:12.637188 29775 webserver.cc:460] Webserver started at http://127.10.192.126:44199/ using document root <none> and password file <none>
I20260619 06:43:12.637966 29775 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:12.638100 29775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:12.638428 29775 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:12.641705 29775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "b6e1cd8653334c35868116d41db94708"
format_stamp: "Formatted at 2026-06-19 06:43:12 on dist-test-slave-7lz4"
server_key: "415604bf6f8f4ea89eaade654fccc9ad"
server_key_iv: "984f8caf7912ee66af14df2a90a375d3"
server_key_version: "encryptionkey@0"
I20260619 06:43:12.642580 29775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "b6e1cd8653334c35868116d41db94708"
format_stamp: "Formatted at 2026-06-19 06:43:12 on dist-test-slave-7lz4"
server_key: "415604bf6f8f4ea89eaade654fccc9ad"
server_key_iv: "984f8caf7912ee66af14df2a90a375d3"
server_key_version: "encryptionkey@0"
I20260619 06:43:12.648042 29775 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.006s
I20260619 06:43:12.651592 29789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:12.653142 29775 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:43:12.653328 29775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "b6e1cd8653334c35868116d41db94708"
format_stamp: "Formatted at 2026-06-19 06:43:12 on dist-test-slave-7lz4"
server_key: "415604bf6f8f4ea89eaade654fccc9ad"
server_key_iv: "984f8caf7912ee66af14df2a90a375d3"
server_key_version: "encryptionkey@0"
I20260619 06:43:12.653549 29775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:12.666572 29775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:12.667428 29775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:12.667763 29775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:12.686501 29775 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:45317
I20260619 06:43:12.686527 29840 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:45317 every 8 connection(s)
I20260619 06:43:12.688007 29775 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:12.690923 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 29775
I20260619 06:43:12.691093 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:12.691524 11009 external_mini_cluster.cc:1428] Setting key 6b7c2e9545a56482b480f44f65e6e387
I20260619 06:43:12.692267 29841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:12.709410 29841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708: Bootstrap starting.
I20260619 06:43:12.709460 29844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:12.693534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59190 (local address 127.10.192.126:45317)
0619 06:43:12.694606 (+ 1072us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:12.694623 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:12.694676 (+ 53us) server_negotiation.cc:407] Connection header received
0619 06:43:12.697160 (+ 2484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:12.697191 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:12.697854 (+ 663us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:12.698326 (+ 472us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:12.698873 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:12.700907 (+ 2034us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:12.703270 (+ 2363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:12.704390 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:12.704588 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:12.706206 (+ 1618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:12.706217 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:12.706241 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:12.707085 (+ 844us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:12.707202 (+ 117us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:12.707237 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:12.707343 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:12.707618 (+ 275us) server_negotiation.cc:299] Negotiation successful
0619 06:43:12.708041 (+ 423us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":569,"thread_start_us":361,"threads_started":1}
I20260619 06:43:12.713277 29841 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:12.714253 29841 log.cc:824] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:12.717099 29841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708: No bootstrap required, opened a new log
I20260619 06:43:12.724869 29841 raft_consensus.cc:348] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6e1cd8653334c35868116d41db94708" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 45317 } }
I20260619 06:43:12.725270 29841 raft_consensus.cc:374] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:12.725368 29841 raft_consensus.cc:729] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6e1cd8653334c35868116d41db94708, State: Initialized, Role: FOLLOWER
I20260619 06:43:12.726008 29841 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6e1cd8653334c35868116d41db94708" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 45317 } }
I20260619 06:43:12.726279 29841 raft_consensus.cc:388] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:12.726410 29841 raft_consensus.cc:482] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:12.726599 29841 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:12.728890 29841 raft_consensus.cc:504] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6e1cd8653334c35868116d41db94708" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 45317 } }
I20260619 06:43:12.729454 29841 leader_election.cc:302] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6e1cd8653334c35868116d41db94708; no voters:
I20260619 06:43:12.730057 29841 leader_election.cc:288] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:12.730206 29846 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:12.730913 29846 raft_consensus.cc:686] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708 [term 1 LEADER]: Becoming Leader. State: Replica: b6e1cd8653334c35868116d41db94708, State: Running, Role: LEADER
I20260619 06:43:12.731577 29846 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6e1cd8653334c35868116d41db94708" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 45317 } }
I20260619 06:43:12.732381 29841 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:12.734683 29848 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6e1cd8653334c35868116d41db94708. Latest consensus state: current_term: 1 leader_uuid: "b6e1cd8653334c35868116d41db94708" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6e1cd8653334c35868116d41db94708" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 45317 } } }
I20260619 06:43:12.735170 29848 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:12.735241 29847 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6e1cd8653334c35868116d41db94708" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6e1cd8653334c35868116d41db94708" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 45317 } } }
I20260619 06:43:12.735579 29847 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:12.736284 29855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:12.742707 29855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:12.753285 29855 catalog_manager.cc:1347] Generated new cluster ID: a06c90f5313e4c1bb72b1eca6b0c0298
I20260619 06:43:12.753429 29855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:12.767439 29855 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:12.768870 29855 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:12.782558 29855 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708: Generated new TSK 0
I20260619 06:43:12.783699 29855 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:12.799052 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:45317
--builtin_ntp_servers=127.10.192.84:44703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260619 06:43:13.146129 29865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:13.146430 29865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:13.146520 29865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:13.154188 29865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:13.154305 29865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:13.154419 29865 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:43:13.164171 29865 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:44703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:45317
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:13.165506 29865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:13.167407 29865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:13.181039 29873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:13.181087 29871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:13.181011 29870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:13.185220 29865 server_base.cc:1034] running on GCE node
I20260619 06:43:13.185928 29865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:13.186960 29865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:13.188161 29865 hybrid_clock.cc:648] HybridClock initialized: now 1781851393188093 us; error 64 us; skew 500 ppm
I20260619 06:43:13.188532 29865 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:43:13.190979 29865 webserver.cc:460] Webserver started at http://127.10.192.65:43925/ using document root <none> and password file <none>
I20260619 06:43:13.191766 29865 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:13.191890 29865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:13.192234 29865 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:13.195174 29865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "dbeeeabc7cec426b8405bcd328784bd7"
format_stamp: "Formatted at 2026-06-19 06:43:13 on dist-test-slave-7lz4"
server_key: "bce937b3d59dff517151c96d4e752d81"
server_key_iv: "d923a4bcdbb2f32c0b83809adf7e01db"
server_key_version: "encryptionkey@0"
I20260619 06:43:13.196045 29865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "dbeeeabc7cec426b8405bcd328784bd7"
format_stamp: "Formatted at 2026-06-19 06:43:13 on dist-test-slave-7lz4"
server_key: "bce937b3d59dff517151c96d4e752d81"
server_key_iv: "d923a4bcdbb2f32c0b83809adf7e01db"
server_key_version: "encryptionkey@0"
I20260619 06:43:13.201383 29865 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 06:43:13.205044 29879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:13.206477 29865 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:43:13.206663 29865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "dbeeeabc7cec426b8405bcd328784bd7"
format_stamp: "Formatted at 2026-06-19 06:43:13 on dist-test-slave-7lz4"
server_key: "bce937b3d59dff517151c96d4e752d81"
server_key_iv: "d923a4bcdbb2f32c0b83809adf7e01db"
server_key_version: "encryptionkey@0"
I20260619 06:43:13.206904 29865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:13.239305 29865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:13.240357 29865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:13.240686 29865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:13.241755 29865 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:43:13.243251 29865 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:43:13.243345 29865 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:13.243433 29865 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:43:13.243489 29865 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:13.277858 29865 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:39337
I20260619 06:43:13.277943 29991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:39337 every 8 connection(s)
I20260619 06:43:13.279263 29865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:43:13.288534 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 29865
I20260619 06:43:13.288731 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:43:13.289170 11009 external_mini_cluster.cc:1428] Setting key 96c31d99ffb7d57b5b7be347645f07ab
I20260619 06:43:13.292191 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:45317
--builtin_ntp_servers=127.10.192.84:44703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260619 06:43:13.293105 29994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:13.282065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:34263 (local address 127.10.192.126:45317)
0619 06:43:13.282581 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:13.282587 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:13.283925 (+ 1338us) server_negotiation.cc:407] Connection header received
0619 06:43:13.285820 (+ 1895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:13.285843 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:13.285918 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:13.286022 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:13.287160 (+ 1138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:13.287990 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:13.289789 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:13.290304 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:13.290445 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:13.291997 (+ 1552us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:13.292008 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:13.292016 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:13.292040 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:13.292092 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:13.292109 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:13.292218 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:13.292523 (+ 305us) server_negotiation.cc:299] Negotiation successful
0619 06:43:13.292636 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":228,"threads_started":1}
I20260619 06:43:13.293948 29995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:13.282722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:45317 (local address 127.10.192.65:34263)
0619 06:43:13.283764 (+ 1042us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:13.283803 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:13.285537 (+ 1734us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:13.286248 (+ 711us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:13.286258 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:13.286356 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:43:13.286986 (+ 630us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:13.287003 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:13.288128 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:13.288131 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:13.289626 (+ 1495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:13.289639 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:13.290529 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:13.290535 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:13.290753 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:13.291588 (+ 835us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:43:13.291590 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:43:13.291681 (+ 91us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:43:13.291781 (+ 100us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:43:13.292213 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:43:13.292221 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:43:13.292227 (+ 6us) client_negotiation.cc:769] Sending connection context
0619 06:43:13.292458 (+ 231us) client_negotiation.cc:240] Negotiation successful
0619 06:43:13.292789 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":296,"threads_started":1}
I20260619 06:43:13.295579 29992 heartbeater.cc:347] Connected to a master server at 127.10.192.126:45317
I20260619 06:43:13.295948 29992 heartbeater.cc:464] Registering TS with master...
I20260619 06:43:13.296888 29992 heartbeater.cc:511] Master 127.10.192.126:45317 requested a full tablet report, sending...
I20260619 06:43:13.299221 29806 ts_manager.cc:194] Registered new tserver with Master: dbeeeabc7cec426b8405bcd328784bd7 (127.10.192.65:39337)
I20260619 06:43:13.301384 29806 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.192.65:34263
W20260619 06:43:13.624955 29996 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:13.625237 29996 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:13.625324 29996 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:13.632915 29996 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:13.633028 29996 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:13.633204 29996 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:43:13.643069 29996 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:44703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:45317
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:13.644447 29996 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:13.646291 29996 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:13.660465 30004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:13.660491 30001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:13.660555 30002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:13.661226 29996 server_base.cc:1034] running on GCE node
I20260619 06:43:13.661829 29996 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:13.662810 29996 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:13.664011 29996 hybrid_clock.cc:648] HybridClock initialized: now 1781851393663963 us; error 38 us; skew 500 ppm
I20260619 06:43:13.664335 29996 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:43:13.666687 29996 webserver.cc:460] Webserver started at http://127.10.192.66:37597/ using document root <none> and password file <none>
I20260619 06:43:13.667410 29996 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:13.667531 29996 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:13.667877 29996 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:13.670780 29996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "1b378b3613d743dfb5183a3d1fcf637f"
format_stamp: "Formatted at 2026-06-19 06:43:13 on dist-test-slave-7lz4"
server_key: "545ecf2f000e7536b91a595ac0dac3bd"
server_key_iv: "6df86aeb1aa71fee8b9bd4798bc3b3b0"
server_key_version: "encryptionkey@0"
I20260619 06:43:13.671582 29996 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "1b378b3613d743dfb5183a3d1fcf637f"
format_stamp: "Formatted at 2026-06-19 06:43:13 on dist-test-slave-7lz4"
server_key: "545ecf2f000e7536b91a595ac0dac3bd"
server_key_iv: "6df86aeb1aa71fee8b9bd4798bc3b3b0"
server_key_version: "encryptionkey@0"
I20260619 06:43:13.676852 29996 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.000s
I20260619 06:43:13.680606 30010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:13.681986 29996 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:43:13.682178 29996 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "1b378b3613d743dfb5183a3d1fcf637f"
format_stamp: "Formatted at 2026-06-19 06:43:13 on dist-test-slave-7lz4"
server_key: "545ecf2f000e7536b91a595ac0dac3bd"
server_key_iv: "6df86aeb1aa71fee8b9bd4798bc3b3b0"
server_key_version: "encryptionkey@0"
I20260619 06:43:13.682416 29996 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:13.697754 29996 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:13.698650 29996 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:13.698976 29996 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:13.700073 29996 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:43:13.701643 29996 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:43:13.701733 29996 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:13.701869 29996 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:43:13.701946 29996 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:13.735023 29996 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:34431
I20260619 06:43:13.735044 30122 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:34431 every 8 connection(s)
I20260619 06:43:13.736485 29996 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:43:13.740080 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 29996
I20260619 06:43:13.740276 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:43:13.740876 11009 external_mini_cluster.cc:1428] Setting key 7e74e5052a245f1c93307370eaf0e997
I20260619 06:43:13.743762 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:45317
--builtin_ntp_servers=127.10.192.84:44703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260619 06:43:13.750181 29994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:13.739287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:51519 (local address 127.10.192.126:45317)
0619 06:43:13.739476 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:13.739480 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:13.741239 (+ 1759us) server_negotiation.cc:407] Connection header received
0619 06:43:13.743378 (+ 2139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:13.743383 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:13.743476 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:13.743582 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:13.744752 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:13.745504 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:13.747199 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:13.747716 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:13.747845 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:13.749360 (+ 1515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:13.749367 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:13.749371 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:13.749399 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:13.749432 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:13.749444 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:13.749539 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:13.749762 (+ 223us) server_negotiation.cc:299] Negotiation successful
0619 06:43:13.749867 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260619 06:43:13.751348 30125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:13.740012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:45317 (local address 127.10.192.66:51519)
0619 06:43:13.741089 (+ 1077us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:13.741126 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:13.743080 (+ 1954us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:13.743905 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:13.743921 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:13.744039 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:43:13.744592 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:13.744609 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:13.745660 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:13.745666 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:13.746913 (+ 1247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:13.746925 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:13.747950 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:13.747959 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:13.748194 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:13.749020 (+ 826us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:43:13.749023 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:43:13.749065 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:43:13.749151 (+ 86us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:43:13.749538 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:43:13.749550 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:43:13.749560 (+ 10us) client_negotiation.cc:769] Sending connection context
0619 06:43:13.749752 (+ 192us) client_negotiation.cc:240] Negotiation successful
0619 06:43:13.750187 (+ 435us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":339,"threads_started":1}
I20260619 06:43:13.753055 30123 heartbeater.cc:347] Connected to a master server at 127.10.192.126:45317
I20260619 06:43:13.753369 30123 heartbeater.cc:464] Registering TS with master...
I20260619 06:43:13.754124 30123 heartbeater.cc:511] Master 127.10.192.126:45317 requested a full tablet report, sending...
I20260619 06:43:13.755666 29806 ts_manager.cc:194] Registered new tserver with Master: 1b378b3613d743dfb5183a3d1fcf637f (127.10.192.66:34431)
I20260619 06:43:13.756954 29806 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.192.66:51519
W20260619 06:43:14.080911 30126 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:14.081200 30126 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:14.081286 30126 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:14.088688 30126 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:14.088800 30126 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:14.088909 30126 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:43:14.098168 30126 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:44703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:45317
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:14.099472 30126 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:14.101387 30126 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:14.114789 30132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:14.114806 30134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:14.114842 30131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:14.115693 30126 server_base.cc:1034] running on GCE node
I20260619 06:43:14.116298 30126 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:14.117267 30126 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:14.118503 30126 hybrid_clock.cc:648] HybridClock initialized: now 1781851394118454 us; error 44 us; skew 500 ppm
I20260619 06:43:14.118825 30126 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:43:14.121161 30126 webserver.cc:460] Webserver started at http://127.10.192.67:33725/ using document root <none> and password file <none>
I20260619 06:43:14.121865 30126 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:14.122005 30126 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:14.122355 30126 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:14.125346 30126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "a6bc9f06da384f5385094ae5e02627ea"
format_stamp: "Formatted at 2026-06-19 06:43:14 on dist-test-slave-7lz4"
server_key: "367f0ca8d59d35db9cb0a0508073eac5"
server_key_iv: "8269474ec60ce3bb751233fe81ac3efe"
server_key_version: "encryptionkey@0"
I20260619 06:43:14.126150 30126 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "a6bc9f06da384f5385094ae5e02627ea"
format_stamp: "Formatted at 2026-06-19 06:43:14 on dist-test-slave-7lz4"
server_key: "367f0ca8d59d35db9cb0a0508073eac5"
server_key_iv: "8269474ec60ce3bb751233fe81ac3efe"
server_key_version: "encryptionkey@0"
I20260619 06:43:14.131354 30126 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.004s
I20260619 06:43:14.135192 30140 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:14.136756 30126 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:43:14.136948 30126 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "a6bc9f06da384f5385094ae5e02627ea"
format_stamp: "Formatted at 2026-06-19 06:43:14 on dist-test-slave-7lz4"
server_key: "367f0ca8d59d35db9cb0a0508073eac5"
server_key_iv: "8269474ec60ce3bb751233fe81ac3efe"
server_key_version: "encryptionkey@0"
I20260619 06:43:14.137179 30126 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:14.170066 30126 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:14.170966 30126 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:14.171281 30126 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:14.172330 30126 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:43:14.173799 30126 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:43:14.173888 30126 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:14.173975 30126 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:43:14.174031 30126 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:14.208163 30126 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:38133
I20260619 06:43:14.208225 30252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:38133 every 8 connection(s)
I20260619 06:43:14.209477 30126 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:43:14.212505 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 30126
I20260619 06:43:14.212687 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:43:14.213215 11009 external_mini_cluster.cc:1428] Setting key 1c552682ffb71ff1b69a8a7aaa59c0ef
I20260619 06:43:14.223053 29994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.212270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:59299 (local address 127.10.192.126:45317)
0619 06:43:14.212454 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:14.212459 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:14.214435 (+ 1976us) server_negotiation.cc:407] Connection header received
0619 06:43:14.216869 (+ 2434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:14.216874 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:14.216949 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:14.217029 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:14.218113 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.218832 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.220516 (+ 1684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.220909 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.221015 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:14.222376 (+ 1361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:14.222380 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:14.222383 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:14.222402 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:14.222429 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:14.222440 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:14.222505 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:14.222698 (+ 193us) server_negotiation.cc:299] Negotiation successful
0619 06:43:14.222775 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260619 06:43:14.224172 30255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.213101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:45317 (local address 127.10.192.67:59299)
0619 06:43:14.214225 (+ 1124us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:14.214293 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:14.216613 (+ 2320us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:14.217249 (+ 636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:14.217258 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:14.217354 (+ 96us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:43:14.217959 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:14.217986 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.218989 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.218994 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:14.220393 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:14.220404 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.221126 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.221131 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:14.221330 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:14.222091 (+ 761us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:43:14.222093 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:43:14.222136 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:43:14.222215 (+ 79us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:43:14.222521 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:43:14.222528 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:43:14.222533 (+ 5us) client_negotiation.cc:769] Sending connection context
0619 06:43:14.222674 (+ 141us) client_negotiation.cc:240] Negotiation successful
0619 06:43:14.222981 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":521,"thread_start_us":318,"threads_started":1}
I20260619 06:43:14.225601 30253 heartbeater.cc:347] Connected to a master server at 127.10.192.126:45317
I20260619 06:43:14.225907 30253 heartbeater.cc:464] Registering TS with master...
I20260619 06:43:14.226684 30253 heartbeater.cc:511] Master 127.10.192.126:45317 requested a full tablet report, sending...
I20260619 06:43:14.228364 29806 ts_manager.cc:194] Registered new tserver with Master: a6bc9f06da384f5385094ae5e02627ea (127.10.192.67:38133)
I20260619 06:43:14.229017 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 06:43:14.229372 29806 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.192.67:59299
I20260619 06:43:14.239034 29994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.233323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59192 (local address 127.10.192.126:45317)
0619 06:43:14.233562 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:14.233571 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:14.233926 (+ 355us) server_negotiation.cc:407] Connection header received
0619 06:43:14.234057 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:14.234061 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:14.234132 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:14.234213 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:14.234725 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.235384 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.236776 (+ 1392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.237208 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.237299 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:14.238392 (+ 1093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:14.238397 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:14.238401 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:14.238418 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:14.238470 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:14.238483 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:14.238598 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:14.238754 (+ 156us) server_negotiation.cc:299] Negotiation successful
0619 06:43:14.238802 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 06:43:14.243029 29806 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59192:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:43:14.250123 29806 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:43:14.273665 30265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.262537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:34431 (local address 127.0.0.1:59480)
0619 06:43:14.263862 (+ 1325us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:14.263900 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:14.264114 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:14.265243 (+ 1129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:14.265250 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:14.265281 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:14.265758 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:14.265776 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.268430 (+ 2654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.268438 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:14.270470 (+ 2032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:14.270488 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.272783 (+ 2295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.272789 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:14.273018 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:14.273089 (+ 71us) client_negotiation.cc:769] Sending connection context
0619 06:43:14.273229 (+ 140us) client_negotiation.cc:240] Negotiation successful
0619 06:43:14.273393 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1126,"mutex_wait_us":30,"thread_start_us":946,"threads_started":1}
I20260619 06:43:14.276083 30266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.262592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59480 (local address 127.10.192.66:34431)
0619 06:43:14.263312 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:14.263323 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:14.264019 (+ 696us) server_negotiation.cc:407] Connection header received
0619 06:43:14.264399 (+ 380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:14.264421 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:14.264728 (+ 307us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:14.264946 (+ 218us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:14.266039 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.268197 (+ 2158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.270693 (+ 2496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.272270 (+ 1577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.272398 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:14.272648 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:14.274361 (+ 1713us) server_negotiation.cc:299] Negotiation successful
0619 06:43:14.275680 (+ 1319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":441,"threads_started":1}
I20260619 06:43:14.280354 30269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.264831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:38133 (local address 127.0.0.1:33582)
0619 06:43:14.271418 (+ 6587us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:14.271432 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:14.271590 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:14.272175 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:14.272179 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:14.272204 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:14.272594 (+ 390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:14.272604 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.274704 (+ 2100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.274709 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:14.277221 (+ 2512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:14.277242 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.279262 (+ 2020us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.279271 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:14.279687 (+ 416us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:14.279755 (+ 68us) client_negotiation.cc:769] Sending connection context
0619 06:43:14.279858 (+ 103us) client_negotiation.cc:240] Negotiation successful
0619 06:43:14.280037 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6450,"thread_start_us":6303,"threads_started":1}
I20260619 06:43:14.281380 30270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.265335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33582 (local address 127.10.192.67:38133)
0619 06:43:14.268867 (+ 3532us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:14.268877 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:14.271552 (+ 2675us) server_negotiation.cc:407] Connection header received
0619 06:43:14.271797 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:14.271804 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:14.271988 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:14.272189 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:14.272774 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.274525 (+ 1751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.277526 (+ 3001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.278993 (+ 1467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.279151 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:14.279407 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:14.280843 (+ 1436us) server_negotiation.cc:299] Negotiation successful
0619 06:43:14.281053 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3358,"thread_start_us":3206,"threads_started":1}
I20260619 06:43:14.285310 30058 tablet_service.cc:1467] Processing CreateTablet for tablet 02efac9a0ca74132a7fb8137cbdd9742 (DEFAULT_TABLE table=test-table [id=4dcff680df3f496a83657802cd406d0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:43:14.287025 30267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.264214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:39337 (local address 127.0.0.1:35208)
0619 06:43:14.264818 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:14.264841 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:14.264996 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:14.267731 (+ 2735us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:14.267738 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:14.267776 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:14.268326 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:14.268341 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.270928 (+ 2587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.270934 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:14.273097 (+ 2163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:14.273109 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.286208 (+ 13099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.286215 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:14.286466 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:14.286507 (+ 41us) client_negotiation.cc:769] Sending connection context
0619 06:43:14.286615 (+ 108us) client_negotiation.cc:240] Negotiation successful
0619 06:43:14.286747 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":435,"mutex_wait_us":1,"thread_start_us":297,"threads_started":1}
I20260619 06:43:14.287149 30058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02efac9a0ca74132a7fb8137cbdd9742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:14.287925 30268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.264554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35208 (local address 127.10.192.65:39337)
0619 06:43:14.265477 (+ 923us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:14.265491 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:14.265527 (+ 36us) server_negotiation.cc:407] Connection header received
0619 06:43:14.267102 (+ 1575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:14.267117 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:14.267441 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:14.268544 (+ 1103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:14.268804 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.270774 (+ 1970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.273287 (+ 2513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.284159 (+ 10872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.284295 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:14.284576 (+ 281us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:14.287338 (+ 2762us) server_negotiation.cc:299] Negotiation successful
0619 06:43:14.287547 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":790,"thread_start_us":677,"threads_started":1}
I20260619 06:43:14.290025 30188 tablet_service.cc:1467] Processing CreateTablet for tablet 02efac9a0ca74132a7fb8137cbdd9742 (DEFAULT_TABLE table=test-table [id=4dcff680df3f496a83657802cd406d0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:43:14.291658 30188 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02efac9a0ca74132a7fb8137cbdd9742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:14.291961 29927 tablet_service.cc:1467] Processing CreateTablet for tablet 02efac9a0ca74132a7fb8137cbdd9742 (DEFAULT_TABLE table=test-table [id=4dcff680df3f496a83657802cd406d0d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:43:14.293105 29927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02efac9a0ca74132a7fb8137cbdd9742. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:14.303140 30271 tablet_bootstrap.cc:492] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f: Bootstrap starting.
I20260619 06:43:14.304656 29992 heartbeater.cc:503] Master 127.10.192.126:45317 was elected leader, sending a full tablet report...
I20260619 06:43:14.310003 30271 tablet_bootstrap.cc:654] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:14.310868 30272 tablet_bootstrap.cc:492] T 02efac9a0ca74132a7fb8137cbdd9742 P dbeeeabc7cec426b8405bcd328784bd7: Bootstrap starting.
I20260619 06:43:14.311583 30271 log.cc:824] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:14.315282 30271 tablet_bootstrap.cc:492] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f: No bootstrap required, opened a new log
I20260619 06:43:14.315551 30272 tablet_bootstrap.cc:654] T 02efac9a0ca74132a7fb8137cbdd9742 P dbeeeabc7cec426b8405bcd328784bd7: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:14.316208 30271 ts_tablet_manager.cc:1397] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.003s
I20260619 06:43:14.316896 30272 log.cc:824] T 02efac9a0ca74132a7fb8137cbdd9742 P dbeeeabc7cec426b8405bcd328784bd7: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:14.318113 30273 tablet_bootstrap.cc:492] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea: Bootstrap starting.
I20260619 06:43:14.320701 30272 tablet_bootstrap.cc:492] T 02efac9a0ca74132a7fb8137cbdd9742 P dbeeeabc7cec426b8405bcd328784bd7: No bootstrap required, opened a new log
I20260619 06:43:14.321008 30272 ts_tablet_manager.cc:1397] T 02efac9a0ca74132a7fb8137cbdd9742 P dbeeeabc7cec426b8405bcd328784bd7: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260619 06:43:14.324155 30273 tablet_bootstrap.cc:654] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:14.325435 30273 log.cc:824] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:14.328204 30271 raft_consensus.cc:348] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b378b3613d743dfb5183a3d1fcf637f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34431 } } peers { permanent_uuid: "dbeeeabc7cec426b8405bcd328784bd7" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 39337 } } peers { permanent_uuid: "a6bc9f06da384f5385094ae5e02627ea" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38133 } }
I20260619 06:43:14.328750 30271 raft_consensus.cc:374] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:14.330654 30271 raft_consensus.cc:729] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b378b3613d743dfb5183a3d1fcf637f, State: Initialized, Role: FOLLOWER
I20260619 06:43:14.331488 30271 consensus_queue.cc:260] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b378b3613d743dfb5183a3d1fcf637f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34431 } } peers { permanent_uuid: "dbeeeabc7cec426b8405bcd328784bd7" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 39337 } } peers { permanent_uuid: "a6bc9f06da384f5385094ae5e02627ea" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38133 } }
I20260619 06:43:14.332798 30123 heartbeater.cc:503] Master 127.10.192.126:45317 was elected leader, sending a full tablet report...
I20260619 06:43:14.333608 30271 ts_tablet_manager.cc:1428] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f: Time spent starting tablet: real 0.017s user 0.011s sys 0.004s
I20260619 06:43:14.335228 30273 tablet_bootstrap.cc:492] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea: No bootstrap required, opened a new log
I20260619 06:43:14.335564 30273 ts_tablet_manager.cc:1397] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.011s
I20260619 06:43:14.335489 30272 raft_consensus.cc:348] T 02efac9a0ca74132a7fb8137cbdd9742 P dbeeeabc7cec426b8405bcd328784bd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b378b3613d743dfb5183a3d1fcf637f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34431 } } peers { permanent_uuid: "dbeeeabc7cec426b8405bcd328784bd7" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 39337 } } peers { permanent_uuid: "a6bc9f06da384f5385094ae5e02627ea" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38133 } }
I20260619 06:43:14.336002 30272 raft_consensus.cc:374] T 02efac9a0ca74132a7fb8137cbdd9742 P dbeeeabc7cec426b8405bcd328784bd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:14.336115 30272 raft_consensus.cc:729] T 02efac9a0ca74132a7fb8137cbdd9742 P dbeeeabc7cec426b8405bcd328784bd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dbeeeabc7cec426b8405bcd328784bd7, State: Initialized, Role: FOLLOWER
I20260619 06:43:14.336789 30272 consensus_queue.cc:260] T 02efac9a0ca74132a7fb8137cbdd9742 P dbeeeabc7cec426b8405bcd328784bd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b378b3613d743dfb5183a3d1fcf637f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34431 } } peers { permanent_uuid: "dbeeeabc7cec426b8405bcd328784bd7" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 39337 } } peers { permanent_uuid: "a6bc9f06da384f5385094ae5e02627ea" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38133 } }
I20260619 06:43:14.338650 30272 ts_tablet_manager.cc:1428] T 02efac9a0ca74132a7fb8137cbdd9742 P dbeeeabc7cec426b8405bcd328784bd7: Time spent starting tablet: real 0.018s user 0.009s sys 0.007s
I20260619 06:43:14.346426 30273 raft_consensus.cc:348] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b378b3613d743dfb5183a3d1fcf637f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34431 } } peers { permanent_uuid: "dbeeeabc7cec426b8405bcd328784bd7" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 39337 } } peers { permanent_uuid: "a6bc9f06da384f5385094ae5e02627ea" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38133 } }
I20260619 06:43:14.346997 30273 raft_consensus.cc:374] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:14.347122 30273 raft_consensus.cc:729] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6bc9f06da384f5385094ae5e02627ea, State: Initialized, Role: FOLLOWER
I20260619 06:43:14.347821 30273 consensus_queue.cc:260] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b378b3613d743dfb5183a3d1fcf637f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34431 } } peers { permanent_uuid: "dbeeeabc7cec426b8405bcd328784bd7" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 39337 } } peers { permanent_uuid: "a6bc9f06da384f5385094ae5e02627ea" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38133 } }
I20260619 06:43:14.348996 30253 heartbeater.cc:503] Master 127.10.192.126:45317 was elected leader, sending a full tablet report...
I20260619 06:43:14.349639 30273 ts_tablet_manager.cc:1428] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea: Time spent starting tablet: real 0.014s user 0.010s sys 0.003s
I20260619 06:43:14.385392 30277 raft_consensus.cc:482] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:43:14.385671 30277 raft_consensus.cc:504] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b378b3613d743dfb5183a3d1fcf637f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34431 } } peers { permanent_uuid: "dbeeeabc7cec426b8405bcd328784bd7" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 39337 } } peers { permanent_uuid: "a6bc9f06da384f5385094ae5e02627ea" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38133 } }
I20260619 06:43:14.387347 30277 leader_election.cc:288] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dbeeeabc7cec426b8405bcd328784bd7 (127.10.192.65:39337), a6bc9f06da384f5385094ae5e02627ea (127.10.192.67:38133)
I20260619 06:43:14.394565 30268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.388021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:51099 (local address 127.10.192.65:39337)
0619 06:43:14.388262 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:14.388270 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:14.388909 (+ 639us) server_negotiation.cc:407] Connection header received
0619 06:43:14.389012 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:14.389018 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:14.389101 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:14.389215 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:14.389891 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.390927 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.392884 (+ 1957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.393663 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.393852 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:14.393930 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:14.394194 (+ 264us) server_negotiation.cc:299] Negotiation successful
0619 06:43:14.394323 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260619 06:43:14.394671 30280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.387721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:39337 (local address 127.10.192.66:51099)
0619 06:43:14.388403 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:14.388418 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:14.388619 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:14.389292 (+ 673us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:14.389297 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:14.389324 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:14.389739 (+ 415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:14.389755 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.391070 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.391077 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:14.392699 (+ 1622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:14.392712 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.393858 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.393864 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:14.394035 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:14.394059 (+ 24us) client_negotiation.cc:769] Sending connection context
0619 06:43:14.394165 (+ 106us) client_negotiation.cc:240] Negotiation successful
0619 06:43:14.394301 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":533,"mutex_wait_us":24,"thread_start_us":310,"threads_started":1}
I20260619 06:43:14.395136 30281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.388493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:38133 (local address 127.10.192.66:52499)
0619 06:43:14.389087 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:14.389100 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:14.389242 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:14.389691 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:14.389695 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:14.389728 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:14.390108 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:14.390129 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.391350 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.391355 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:14.392935 (+ 1580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:14.392948 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.394106 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.394113 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:14.394284 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:14.394308 (+ 24us) client_negotiation.cc:769] Sending connection context
0619 06:43:14.394407 (+ 99us) client_negotiation.cc:240] Negotiation successful
0619 06:43:14.394543 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":486,"mutex_wait_us":22,"thread_start_us":308,"threads_started":1}
I20260619 06:43:14.395596 30270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.388769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:52499 (local address 127.10.192.67:38133)
0619 06:43:14.388976 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:14.388981 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:14.389195 (+ 214us) server_negotiation.cc:407] Connection header received
0619 06:43:14.389441 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:14.389448 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:14.389529 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:14.389633 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:14.390269 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.391205 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.393118 (+ 1913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.393915 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.394104 (+ 189us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:14.394173 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:14.394486 (+ 313us) server_negotiation.cc:299] Negotiation successful
0619 06:43:14.394609 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 06:43:14.395955 29947 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02efac9a0ca74132a7fb8137cbdd9742" candidate_uuid: "1b378b3613d743dfb5183a3d1fcf637f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbeeeabc7cec426b8405bcd328784bd7" is_pre_election: true
I20260619 06:43:14.396574 29947 raft_consensus.cc:2454] T 02efac9a0ca74132a7fb8137cbdd9742 P dbeeeabc7cec426b8405bcd328784bd7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b378b3613d743dfb5183a3d1fcf637f in term 0.
I20260619 06:43:14.396643 30208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02efac9a0ca74132a7fb8137cbdd9742" candidate_uuid: "1b378b3613d743dfb5183a3d1fcf637f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bc9f06da384f5385094ae5e02627ea" is_pre_election: true
I20260619 06:43:14.397173 30208 raft_consensus.cc:2454] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b378b3613d743dfb5183a3d1fcf637f in term 0.
I20260619 06:43:14.397339 30012 leader_election.cc:302] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b378b3613d743dfb5183a3d1fcf637f, dbeeeabc7cec426b8405bcd328784bd7; no voters:
I20260619 06:43:14.397759 30277 raft_consensus.cc:2781] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:43:14.397909 30277 raft_consensus.cc:482] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:43:14.398031 30277 raft_consensus.cc:3037] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:14.400324 30277 raft_consensus.cc:504] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b378b3613d743dfb5183a3d1fcf637f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34431 } } peers { permanent_uuid: "dbeeeabc7cec426b8405bcd328784bd7" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 39337 } } peers { permanent_uuid: "a6bc9f06da384f5385094ae5e02627ea" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38133 } }
I20260619 06:43:14.400929 30277 leader_election.cc:288] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [CANDIDATE]: Term 1 election: Requested vote from peers dbeeeabc7cec426b8405bcd328784bd7 (127.10.192.65:39337), a6bc9f06da384f5385094ae5e02627ea (127.10.192.67:38133)
I20260619 06:43:14.401374 29947 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02efac9a0ca74132a7fb8137cbdd9742" candidate_uuid: "1b378b3613d743dfb5183a3d1fcf637f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dbeeeabc7cec426b8405bcd328784bd7"
I20260619 06:43:14.401436 30208 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02efac9a0ca74132a7fb8137cbdd9742" candidate_uuid: "1b378b3613d743dfb5183a3d1fcf637f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6bc9f06da384f5385094ae5e02627ea"
I20260619 06:43:14.401571 29947 raft_consensus.cc:3037] T 02efac9a0ca74132a7fb8137cbdd9742 P dbeeeabc7cec426b8405bcd328784bd7 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:14.401688 30208 raft_consensus.cc:3037] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:14.403961 29947 raft_consensus.cc:2454] T 02efac9a0ca74132a7fb8137cbdd9742 P dbeeeabc7cec426b8405bcd328784bd7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b378b3613d743dfb5183a3d1fcf637f in term 1.
I20260619 06:43:14.403980 30208 raft_consensus.cc:2454] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b378b3613d743dfb5183a3d1fcf637f in term 1.
I20260619 06:43:14.404373 30012 leader_election.cc:302] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b378b3613d743dfb5183a3d1fcf637f, a6bc9f06da384f5385094ae5e02627ea; no voters:
I20260619 06:43:14.404738 30277 raft_consensus.cc:2781] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:14.405198 30277 raft_consensus.cc:686] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [term 1 LEADER]: Becoming Leader. State: Replica: 1b378b3613d743dfb5183a3d1fcf637f, State: Running, Role: LEADER
I20260619 06:43:14.405673 30277 consensus_queue.cc:237] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b378b3613d743dfb5183a3d1fcf637f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34431 } } peers { permanent_uuid: "dbeeeabc7cec426b8405bcd328784bd7" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 39337 } } peers { permanent_uuid: "a6bc9f06da384f5385094ae5e02627ea" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38133 } }
I20260619 06:43:14.410980 29805 catalog_manager.cc:5495] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b378b3613d743dfb5183a3d1fcf637f (127.10.192.66). New cstate: current_term: 1 leader_uuid: "1b378b3613d743dfb5183a3d1fcf637f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1b378b3613d743dfb5183a3d1fcf637f" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 34431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dbeeeabc7cec426b8405bcd328784bd7" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 39337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6bc9f06da384f5385094ae5e02627ea" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38133 } health_report { overall_health: UNKNOWN } } }
I20260619 06:43:14.433561 30266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.427425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59488 (local address 127.10.192.66:34431)
0619 06:43:14.427630 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:14.427658 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:14.427681 (+ 23us) server_negotiation.cc:407] Connection header received
0619 06:43:14.427911 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:14.427915 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:14.428016 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:14.428173 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:43:14.428559 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.429673 (+ 1114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.431192 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.431620 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.431797 (+ 177us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:14.432405 (+ 608us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:43:14.432949 (+ 544us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:43:14.433138 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:14.433261 (+ 123us) server_negotiation.cc:299] Negotiation successful
0619 06:43:14.433307 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260619 06:43:14.442090 30208 raft_consensus.cc:1261] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea [term 1 FOLLOWER]: Refusing update from remote peer 1b378b3613d743dfb5183a3d1fcf637f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:43:14.442102 29947 raft_consensus.cc:1261] T 02efac9a0ca74132a7fb8137cbdd9742 P dbeeeabc7cec426b8405bcd328784bd7 [term 1 FOLLOWER]: Refusing update from remote peer 1b378b3613d743dfb5183a3d1fcf637f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:43:14.443240 30282 consensus_queue.cc:1035] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [LEADER]: Connected to new peer: Peer: permanent_uuid: "dbeeeabc7cec426b8405bcd328784bd7" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 39337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:43:14.443642 30277 consensus_queue.cc:1035] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6bc9f06da384f5385094ae5e02627ea" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 38133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:43:14.454980 30286 mvcc.cc:205] Tried to move back new op lower bound from 7298463311624048640 to 7298463311489912832. Current Snapshot: MvccSnapshot[applied={T|T < 7298463311624048640}]
I20260619 06:43:14.473165 29805 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:43:14.473496 29805 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59192:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:43:14.477424 29805 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b6e1cd8653334c35868116d41db94708: Sending DeleteTablet for 3 replicas of tablet 02efac9a0ca74132a7fb8137cbdd9742
I20260619 06:43:14.478590 30058 tablet_service.cc:1514] Processing DeleteTablet for tablet 02efac9a0ca74132a7fb8137cbdd9742 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:43:14 UTC) from {username='slave'} at 127.0.0.1:59480
I20260619 06:43:14.479044 29927 tablet_service.cc:1514] Processing DeleteTablet for tablet 02efac9a0ca74132a7fb8137cbdd9742 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:43:14 UTC) from {username='slave'} at 127.0.0.1:35208
I20260619 06:43:14.479759 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 29865
I20260619 06:43:14.479817 30188 tablet_service.cc:1514] Processing DeleteTablet for tablet 02efac9a0ca74132a7fb8137cbdd9742 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:43:14 UTC) from {username='slave'} at 127.0.0.1:33582
I20260619 06:43:14.495285 30296 tablet_replica.cc:330] T 02efac9a0ca74132a7fb8137cbdd9742 P dbeeeabc7cec426b8405bcd328784bd7: stopping tablet replica
I20260619 06:43:14.495973 30296 raft_consensus.cc:2229] T 02efac9a0ca74132a7fb8137cbdd9742 P dbeeeabc7cec426b8405bcd328784bd7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:43:14.496663 30296 raft_consensus.cc:2258] T 02efac9a0ca74132a7fb8137cbdd9742 P dbeeeabc7cec426b8405bcd328784bd7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:43:14.497295 30297 tablet_replica.cc:330] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea: stopping tablet replica
I20260619 06:43:14.497896 30297 raft_consensus.cc:2229] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:43:14.498410 30297 raft_consensus.cc:2258] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:43:14.500754 30296 ts_tablet_manager.cc:1905] T 02efac9a0ca74132a7fb8137cbdd9742 P dbeeeabc7cec426b8405bcd328784bd7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:43:14.501281 30297 ts_tablet_manager.cc:1905] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:43:14.501557 30295 tablet_replica.cc:330] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f: stopping tablet replica
I20260619 06:43:14.502002 30295 raft_consensus.cc:2229] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:43:14.505000 30268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.481316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38132 (local address 127.10.192.65:39337)
0619 06:43:14.481537 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:14.481548 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:14.493014 (+ 11466us) server_negotiation.cc:407] Connection header received
0619 06:43:14.493602 (+ 588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:14.493611 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:14.493760 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:14.493855 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:14.497187 (+ 3332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.498711 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.500993 (+ 2282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.501647 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.501754 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:14.503236 (+ 1482us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:14.503247 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:14.503262 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:14.504059 (+ 797us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:14.504117 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:14.504146 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:14.504236 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:14.504459 (+ 223us) server_negotiation.cc:299] Negotiation successful
0619 06:43:14.504576 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 06:43:14.505820 30295 raft_consensus.cc:2258] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:43:14.506145 29987 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:14.509209 30295 ts_tablet_manager.cc:1905] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:43:14.510380 30297 ts_tablet_manager.cc:1918] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:43:14.510556 30297 log.cc:1196] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/02efac9a0ca74132a7fb8137cbdd9742
I20260619 06:43:14.511125 30297 ts_tablet_manager.cc:1939] T 02efac9a0ca74132a7fb8137cbdd9742 P a6bc9f06da384f5385094ae5e02627ea: Deleting consensus metadata
I20260619 06:43:14.513509 29791 catalog_manager.cc:4841] TS a6bc9f06da384f5385094ae5e02627ea (127.10.192.67:38133): tablet 02efac9a0ca74132a7fb8137cbdd9742 (table test-table [id=4dcff680df3f496a83657802cd406d0d]) successfully deleted
I20260619 06:43:14.516940 30295 ts_tablet_manager.cc:1918] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:43:14.517119 30295 log.cc:1196] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/02efac9a0ca74132a7fb8137cbdd9742
I20260619 06:43:14.517642 30295 ts_tablet_manager.cc:1939] T 02efac9a0ca74132a7fb8137cbdd9742 P 1b378b3613d743dfb5183a3d1fcf637f: Deleting consensus metadata
I20260619 06:43:14.519130 29791 catalog_manager.cc:4841] TS 1b378b3613d743dfb5183a3d1fcf637f (127.10.192.66:34431): tablet 02efac9a0ca74132a7fb8137cbdd9742 (table test-table [id=4dcff680df3f496a83657802cd406d0d]) successfully deleted
I20260619 06:43:14.640969 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 29865
W20260619 06:43:14.658605 29791 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.10.192.65:39337 (error 108)
I20260619 06:43:14.658820 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 29996
I20260619 06:43:14.661000 30267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.660501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:39337 (local address 127.0.0.1:38138)
0619 06:43:14.660671 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:14.660814 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:39337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260619 06:43:14.661239 29791 catalog_manager.cc:4584] TS dbeeeabc7cec426b8405bcd328784bd7 (127.10.192.65:39337): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 02efac9a0ca74132a7fb8137cbdd9742: Network error: Client connection negotiation failed: client connection to 127.10.192.65:39337: connect: Connection refused (error 111)
I20260619 06:43:14.666507 30266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.659685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60080 (local address 127.10.192.66:34431)
0619 06:43:14.659880 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:14.659886 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:14.660005 (+ 119us) server_negotiation.cc:407] Connection header received
0619 06:43:14.660149 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:14.660155 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:14.660261 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:14.660371 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:14.660847 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.661831 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.663108 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.663590 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.663916 (+ 326us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:14.665030 (+ 1114us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:14.665045 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:14.665059 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:14.665687 (+ 628us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:14.665734 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:14.665758 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:14.665893 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:14.666047 (+ 154us) server_negotiation.cc:299] Negotiation successful
0619 06:43:14.666147 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260619 06:43:14.667235 30118 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:14.714924 30267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.714441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:39337 (local address 127.0.0.1:38148)
0619 06:43:14.714628 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:14.714744 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:39337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260619 06:43:14.716193 30267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.715812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:39337 (local address 127.0.0.1:38150)
0619 06:43:14.715983 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:14.716068 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:39337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260619 06:43:14.777043 30267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.776588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:39337 (local address 127.0.0.1:38164)
0619 06:43:14.776782 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:14.776877 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:39337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260619 06:43:14.778110 30267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.777781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:39337 (local address 127.0.0.1:38176)
0619 06:43:14.777929 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:14.777999 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:39337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260619 06:43:14.789748 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 29996
I20260619 06:43:14.808763 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 30126
I20260619 06:43:14.815246 30270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.809617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49850 (local address 127.10.192.67:38133)
0619 06:43:14.809788 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:14.809793 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:14.809811 (+ 18us) server_negotiation.cc:407] Connection header received
0619 06:43:14.809980 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:14.810002 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:14.810082 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:14.810169 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:14.810525 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.811275 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.812546 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:14.812930 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:14.813022 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:14.813960 (+ 938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:14.813968 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:14.813982 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:14.814562 (+ 580us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:14.814611 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:14.814631 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:14.814716 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:14.814833 (+ 117us) server_negotiation.cc:299] Negotiation successful
0619 06:43:14.814919 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260619 06:43:14.816031 30248 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:14.858656 30267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.858067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:39337 (local address 127.0.0.1:38188)
0619 06:43:14.858303 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:14.858420 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:39337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260619 06:43:14.859871 30267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:14.859389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:39337 (local address 127.0.0.1:38200)
0619 06:43:14.859616 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:14.859734 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:39337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260619 06:43:14.907500 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 30126
I20260619 06:43:14.924052 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 29775
I20260619 06:43:14.925344 29836 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:15.036546 30267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:15.035685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:39337 (local address 127.0.0.1:38208)
0619 06:43:15.036215 (+ 530us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:15.036336 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.65:39337: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352}
I20260619 06:43:15.036633 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 29775
2026-06-19T06:43:15Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (2857 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:15 dist-test-slave-7lz4 krb5kdc[30306](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:15 dist-test-slave-7lz4 krb5kdc[30306](info): set up 2 sockets
Jun 19 06:43:15 dist-test-slave-7lz4 krb5kdc[30306](info): commencing operation
krb5kdc: starting...
W20260619 06:43:16.156025 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.078s user 0.003s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:16 dist-test-slave-7lz4 krb5kdc[30306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851396, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:43:16.414793 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:39167
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:39167
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:16.762660 30319 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:16.763027 30319 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:16.763177 30319 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:16.770987 30319 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:16.771145 30319 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:16.771247 30319 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:16.771353 30319 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:16.771428 30319 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:16.781955 30319 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:39167
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:39167
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:16.783416 30319 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:16.784842 30319 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:16.797698 30324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:16.797775 30327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:16.797864 30325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:16.799286 30319 server_base.cc:1034] running on GCE node
I20260619 06:43:16.800453 30319 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:16.802012 30319 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:16.803264 30319 hybrid_clock.cc:648] HybridClock initialized: now 1781851396803213 us; error 44 us; skew 500 ppm
I20260619 06:43:16.803696 30319 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:16 dist-test-slave-7lz4 krb5kdc[30306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851396, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:16.806841 30319 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:43:16.808423 30319 webserver.cc:460] Webserver started at http://127.10.192.126:34813/ using document root <none> and password file <none>
I20260619 06:43:16.809430 30319 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:16.809578 30319 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:16.809940 30319 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:16.814134 30319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "c67b8f92aeaf428bac4f1fd637772a4e"
format_stamp: "Formatted at 2026-06-19 06:43:16 on dist-test-slave-7lz4"
server_key: "7e177c168d3c21412dba59e60bb3bd89"
server_key_iv: "cd6407f2b5cce912a9e85f3140a80991"
server_key_version: "encryptionkey@0"
I20260619 06:43:16.814869 30319 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "c67b8f92aeaf428bac4f1fd637772a4e"
format_stamp: "Formatted at 2026-06-19 06:43:16 on dist-test-slave-7lz4"
server_key: "7e177c168d3c21412dba59e60bb3bd89"
server_key_iv: "cd6407f2b5cce912a9e85f3140a80991"
server_key_version: "encryptionkey@0"
I20260619 06:43:16.820477 30319 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260619 06:43:16.824055 30334 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:16.825531 30319 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260619 06:43:16.825742 30319 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "c67b8f92aeaf428bac4f1fd637772a4e"
format_stamp: "Formatted at 2026-06-19 06:43:16 on dist-test-slave-7lz4"
server_key: "7e177c168d3c21412dba59e60bb3bd89"
server_key_iv: "cd6407f2b5cce912a9e85f3140a80991"
server_key_version: "encryptionkey@0"
I20260619 06:43:16.826052 30319 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:16.859470 30319 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:16.863801 30319 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:16.864063 30319 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:16.886929 30319 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:39167
I20260619 06:43:16.886984 30385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:39167 every 8 connection(s)
I20260619 06:43:16.888628 30319 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:16.891337 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 30319
I20260619 06:43:16.891592 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:16.892230 11009 external_mini_cluster.cc:1428] Setting key 543d563ca7160b6b079073cc219997a3
I20260619 06:43:16.893855 30386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Jun 19 06:43:16 dist-test-slave-7lz4 krb5kdc[30306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851396, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:43:16.908638 30386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e: Bootstrap starting.
I20260619 06:43:16.912709 30386 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:16.913908 30386 log.cc:824] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:16.916769 30389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:16.894499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43708 (local address 127.10.192.126:39167)
0619 06:43:16.895370 (+ 871us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:16.895384 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:16.895425 (+ 41us) server_negotiation.cc:407] Connection header received
0619 06:43:16.897171 (+ 1746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:16.897195 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:16.897647 (+ 452us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:16.898089 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:16.899712 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:16.901075 (+ 1363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:16.902404 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:16.903163 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:16.903370 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:16.908931 (+ 5561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:16.908941 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:16.908958 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:16.909010 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:16.912275 (+ 3265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:16.913031 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:16.913045 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:16.913055 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:16.913254 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:16.913675 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:16.913680 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:16.913684 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:16.914323 (+ 639us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:16.914672 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:16.915177 (+ 505us) server_negotiation.cc:299] Negotiation successful
0619 06:43:16.915720 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":649,"thread_start_us":394,"threads_started":1}
I20260619 06:43:16.917426 30386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e: No bootstrap required, opened a new log
I20260619 06:43:16.926010 30386 raft_consensus.cc:348] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67b8f92aeaf428bac4f1fd637772a4e" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39167 } }
I20260619 06:43:16.926470 30386 raft_consensus.cc:374] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:16.926589 30386 raft_consensus.cc:729] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c67b8f92aeaf428bac4f1fd637772a4e, State: Initialized, Role: FOLLOWER
I20260619 06:43:16.927188 30386 consensus_queue.cc:260] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67b8f92aeaf428bac4f1fd637772a4e" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39167 } }
I20260619 06:43:16.927457 30386 raft_consensus.cc:388] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:16.927613 30386 raft_consensus.cc:482] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:16.927851 30386 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:16.930258 30386 raft_consensus.cc:504] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67b8f92aeaf428bac4f1fd637772a4e" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39167 } }
I20260619 06:43:16.930850 30386 leader_election.cc:302] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c67b8f92aeaf428bac4f1fd637772a4e; no voters:
I20260619 06:43:16.931556 30386 leader_election.cc:288] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:16.931727 30391 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:16.932576 30391 raft_consensus.cc:686] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e [term 1 LEADER]: Becoming Leader. State: Replica: c67b8f92aeaf428bac4f1fd637772a4e, State: Running, Role: LEADER
I20260619 06:43:16.933163 30391 consensus_queue.cc:237] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67b8f92aeaf428bac4f1fd637772a4e" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39167 } }
I20260619 06:43:16.933911 30386 sys_catalog.cc:564] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:16.935940 30392 sys_catalog.cc:455] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c67b8f92aeaf428bac4f1fd637772a4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67b8f92aeaf428bac4f1fd637772a4e" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39167 } } }
I20260619 06:43:16.936336 30392 sys_catalog.cc:458] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:16.938098 30393 sys_catalog.cc:455] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e [sys.catalog]: SysCatalogTable state changed. Reason: New leader c67b8f92aeaf428bac4f1fd637772a4e. Latest consensus state: current_term: 1 leader_uuid: "c67b8f92aeaf428bac4f1fd637772a4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c67b8f92aeaf428bac4f1fd637772a4e" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 39167 } } }
I20260619 06:43:16.938570 30393 sys_catalog.cc:458] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:16.940948 30396 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:16.946768 30396 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:16.957079 30396 catalog_manager.cc:1347] Generated new cluster ID: ef9dd7ed2e2d4348b2f825cdc9501363
I20260619 06:43:16.957271 30396 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:16.967571 30396 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:16.969501 30396 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:16.979660 30396 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e: Generated new TSK 0
I20260619 06:43:16.980791 30396 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.10.192.65@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.65@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
Entry for principal kudu/127.10.192.65 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab.
I20260619 06:43:17.043462 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39167
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:17.394280 30412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:17.394598 30412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:17.394780 30412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:17.403081 30412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:17.403218 30412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:17.403455 30412 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:43:17.414475 30412 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.65.keytab
--principal=kudu/127.10.192.65
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39167
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:17.416283 30412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:17.417876 30412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:17.431826 30418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:17.431926 30420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:17.432147 30417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:17.433099 30412 server_base.cc:1034] running on GCE node
I20260619 06:43:17.433743 30412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:17.434855 30412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:17.436066 30412 hybrid_clock.cc:648] HybridClock initialized: now 1781851397435988 us; error 78 us; skew 500 ppm
I20260619 06:43:17.436403 30412 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:17 dist-test-slave-7lz4 krb5kdc[30306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851397, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:17.440071 30412 init.cc:377] Logged in from keytab as kudu/127.10.192.65@KRBTEST.COM (short username kudu)
I20260619 06:43:17.441650 30412 webserver.cc:460] Webserver started at http://127.10.192.65:37399/ using document root <none> and password file <none>
I20260619 06:43:17.442391 30412 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:17.442523 30412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:17.442862 30412 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:17.445979 30412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "649410b23c5f4dda803ccff46bc27269"
format_stamp: "Formatted at 2026-06-19 06:43:17 on dist-test-slave-7lz4"
server_key: "03b28436dd51e1495d41f5d8b68980ee"
server_key_iv: "784fdd65d087a8ec693fe100175d36a9"
server_key_version: "encryptionkey@0"
I20260619 06:43:17.446914 30412 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "649410b23c5f4dda803ccff46bc27269"
format_stamp: "Formatted at 2026-06-19 06:43:17 on dist-test-slave-7lz4"
server_key: "03b28436dd51e1495d41f5d8b68980ee"
server_key_iv: "784fdd65d087a8ec693fe100175d36a9"
server_key_version: "encryptionkey@0"
I20260619 06:43:17.452456 30412 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260619 06:43:17.456192 30427 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:17.457569 30412 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260619 06:43:17.457741 30412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "649410b23c5f4dda803ccff46bc27269"
format_stamp: "Formatted at 2026-06-19 06:43:17 on dist-test-slave-7lz4"
server_key: "03b28436dd51e1495d41f5d8b68980ee"
server_key_iv: "784fdd65d087a8ec693fe100175d36a9"
server_key_version: "encryptionkey@0"
I20260619 06:43:17.457981 30412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:17.492926 30412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:17.497397 30412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:17.497728 30412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:17.498804 30412 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:43:17.500299 30412 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:43:17.500376 30412 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:17.500520 30412 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:43:17.500572 30412 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:17.535193 30412 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:46081
I20260619 06:43:17.535296 30539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:46081 every 8 connection(s)
I20260619 06:43:17.536585 30412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:43:17.539613 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 30412
I20260619 06:43:17.539822 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:43:17.540426 11009 external_mini_cluster.cc:1428] Setting key 2998ae1cf77bcb63776bdff29ca3aac4
Jun 19 06:43:17 dist-test-slave-7lz4 krb5kdc[30306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851397, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.65@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:43:17.560243 30542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:17.539247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:42473 (local address 127.10.192.126:39167)
0619 06:43:17.539799 (+ 552us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:17.539834 (+ 35us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:17.540956 (+ 1122us) server_negotiation.cc:407] Connection header received
0619 06:43:17.543495 (+ 2539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:17.543499 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:17.543576 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:17.543764 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:17.545870 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:17.546589 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:17.549134 (+ 2545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:17.549534 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:17.549631 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:17.553790 (+ 4159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:17.553796 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:17.553799 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:17.553834 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:17.557040 (+ 3206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:17.557820 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:17.557827 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:17.557831 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:17.557962 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:17.558402 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:17.558408 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:17.558411 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:17.558694 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:17.558856 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:17.559590 (+ 734us) server_negotiation.cc:299] Negotiation successful
0619 06:43:17.559856 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":261,"threads_started":1}
I20260619 06:43:17.561357 30543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:17.539918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39167 (local address 127.10.192.65:42473)
0619 06:43:17.540782 (+ 864us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:17.540843 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:17.543155 (+ 2312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:17.544024 (+ 869us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:17.544039 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:17.544871 (+ 832us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:43:17.545699 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:17.545726 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:17.546755 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:17.546762 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:17.548991 (+ 2229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:17.549010 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:17.549773 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:17.549783 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:17.550134 (+ 351us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:17.550894 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:43:17.550933 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:43:17.553526 (+ 2593us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:43:17.557197 (+ 3671us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:17.557206 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:17.557224 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:17.557684 (+ 460us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:17.558076 (+ 392us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:17.558081 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:17.558084 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:17.558281 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:17.558834 (+ 553us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:43:17.558843 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:43:17.559213 (+ 370us) client_negotiation.cc:769] Sending connection context
0619 06:43:17.559483 (+ 270us) client_negotiation.cc:240] Negotiation successful
0619 06:43:17.560097 (+ 614us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":331,"threads_started":1}
I20260619 06:43:17.563176 30540 heartbeater.cc:347] Connected to a master server at 127.10.192.126:39167
I20260619 06:43:17.563527 30540 heartbeater.cc:464] Registering TS with master...
I20260619 06:43:17.564296 30540 heartbeater.cc:511] Master 127.10.192.126:39167 requested a full tablet report, sending...
I20260619 06:43:17.566836 30351 ts_manager.cc:194] Registered new tserver with Master: 649410b23c5f4dda803ccff46bc27269 (127.10.192.65:46081)
WARNING: no policy specified for kudu/127.10.192.66@KRBTEST.COM; defaulting to no policy
I20260619 06:43:17.568645 30351 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.65@KRBTEST.COM'} at 127.10.192.65:42473
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.66@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
Entry for principal kudu/127.10.192.66 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab.
I20260619 06:43:17.599169 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39167
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:17.931130 30546 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:17.931468 30546 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:17.931679 30546 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:17.939147 30546 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:17.939332 30546 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:17.939538 30546 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:43:17.949759 30546 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.66.keytab
--principal=kudu/127.10.192.66
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39167
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:17.951151 30546 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:17.952661 30546 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:17.966646 30551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:17.966686 30552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:17.966710 30554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:17.967592 30546 server_base.cc:1034] running on GCE node
I20260619 06:43:17.968240 30546 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:17.969274 30546 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:17.970484 30546 hybrid_clock.cc:648] HybridClock initialized: now 1781851397970438 us; error 37 us; skew 500 ppm
I20260619 06:43:17.970817 30546 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:17 dist-test-slave-7lz4 krb5kdc[30306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851397, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:17.974087 30546 init.cc:377] Logged in from keytab as kudu/127.10.192.66@KRBTEST.COM (short username kudu)
I20260619 06:43:17.975716 30546 webserver.cc:460] Webserver started at http://127.10.192.66:35833/ using document root <none> and password file <none>
I20260619 06:43:17.976438 30546 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:17.976573 30546 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:17.976912 30546 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:17.980036 30546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "d35d3ca7908249679ca37f74c0fa72d4"
format_stamp: "Formatted at 2026-06-19 06:43:17 on dist-test-slave-7lz4"
server_key: "b50053e41eb658f62d38aa5ff2758594"
server_key_iv: "eb4454e88897d111ab101df12a66586a"
server_key_version: "encryptionkey@0"
I20260619 06:43:17.980858 30546 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "d35d3ca7908249679ca37f74c0fa72d4"
format_stamp: "Formatted at 2026-06-19 06:43:17 on dist-test-slave-7lz4"
server_key: "b50053e41eb658f62d38aa5ff2758594"
server_key_iv: "eb4454e88897d111ab101df12a66586a"
server_key_version: "encryptionkey@0"
I20260619 06:43:17.986462 30546 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260619 06:43:17.990403 30561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:17.991967 30546 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260619 06:43:17.992168 30546 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "d35d3ca7908249679ca37f74c0fa72d4"
format_stamp: "Formatted at 2026-06-19 06:43:17 on dist-test-slave-7lz4"
server_key: "b50053e41eb658f62d38aa5ff2758594"
server_key_iv: "eb4454e88897d111ab101df12a66586a"
server_key_version: "encryptionkey@0"
I20260619 06:43:17.992377 30546 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:18.019524 30546 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:18.023844 30546 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:18.024154 30546 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:18.025177 30546 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:43:18.026598 30546 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:43:18.026710 30546 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:18.026870 30546 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:43:18.026948 30546 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:18.061219 30546 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:37803
I20260619 06:43:18.061264 30673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:37803 every 8 connection(s)
I20260619 06:43:18.062681 30546 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:43:18.064924 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 30546
I20260619 06:43:18.065116 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:43:18.065698 11009 external_mini_cluster.cc:1428] Setting key 9f2a79ce349c72dc07128075d85fafbe
Jun 19 06:43:18 dist-test-slave-7lz4 krb5kdc[30306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851397, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.66@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:43:18.087615 30676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:18.065411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:59389 (local address 127.10.192.126:39167)
0619 06:43:18.065901 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:18.065908 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:18.067101 (+ 1193us) server_negotiation.cc:407] Connection header received
0619 06:43:18.070112 (+ 3011us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:18.070117 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:18.070183 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:18.070275 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:18.072566 (+ 2291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.073291 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.075875 (+ 2584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.076289 (+ 414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.076382 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:18.080381 (+ 3999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:18.080390 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:18.080398 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:18.080452 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:18.084127 (+ 3675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:18.084932 (+ 805us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:18.084941 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:18.084947 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:18.085114 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:18.085555 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:18.085563 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:18.085569 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:18.085979 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:18.086144 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:18.086856 (+ 712us) server_negotiation.cc:299] Negotiation successful
0619 06:43:18.087115 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":355,"thread_start_us":237,"threads_started":1}
I20260619 06:43:18.088378 30677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:18.066033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39167 (local address 127.10.192.66:59389)
0619 06:43:18.066940 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:18.066983 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:18.069763 (+ 2780us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:18.070588 (+ 825us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:18.070603 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:18.071472 (+ 869us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:43:18.072366 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:18.072394 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.073461 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.073469 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:18.075725 (+ 2256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:18.075752 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.076529 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.076538 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:18.076887 (+ 349us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:18.077761 (+ 874us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:43:18.077787 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:43:18.080106 (+ 2319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:43:18.084279 (+ 4173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:18.084286 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:18.084301 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:18.084784 (+ 483us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:18.085223 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:18.085226 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:18.085229 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:18.085426 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:18.086106 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:43:18.086111 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:43:18.086460 (+ 349us) client_negotiation.cc:769] Sending connection context
0619 06:43:18.086691 (+ 231us) client_negotiation.cc:240] Negotiation successful
0619 06:43:18.087098 (+ 407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":627,"thread_start_us":405,"threads_started":1}
I20260619 06:43:18.090059 30674 heartbeater.cc:347] Connected to a master server at 127.10.192.126:39167
I20260619 06:43:18.090431 30674 heartbeater.cc:464] Registering TS with master...
I20260619 06:43:18.091400 30674 heartbeater.cc:511] Master 127.10.192.126:39167 requested a full tablet report, sending...
I20260619 06:43:18.093266 30351 ts_manager.cc:194] Registered new tserver with Master: d35d3ca7908249679ca37f74c0fa72d4 (127.10.192.66:37803)
I20260619 06:43:18.094656 30351 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.66@KRBTEST.COM'} at 127.10.192.66:59389
WARNING: no policy specified for kudu/127.10.192.67@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.67@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
Entry for principal kudu/127.10.192.67 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab.
I20260619 06:43:18.129166 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39167
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:18.468230 30680 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:18.468523 30680 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:18.468616 30680 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:18.475925 30680 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:18.476042 30680 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:18.476156 30680 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:43:18.485930 30680 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.67.keytab
--principal=kudu/127.10.192.67
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:39167
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:18.487200 30680 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:18.488528 30680 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:18.502846 30686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:18.502851 30688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:18.503331 30685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:18.503504 30680 server_base.cc:1034] running on GCE node
I20260619 06:43:18.504211 30680 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:18.505252 30680 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:18.506490 30680 hybrid_clock.cc:648] HybridClock initialized: now 1781851398506448 us; error 61 us; skew 500 ppm
I20260619 06:43:18.506825 30680 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:18 dist-test-slave-7lz4 krb5kdc[30306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851398, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:18.510031 30680 init.cc:377] Logged in from keytab as kudu/127.10.192.67@KRBTEST.COM (short username kudu)
I20260619 06:43:18.511475 30680 webserver.cc:460] Webserver started at http://127.10.192.67:44187/ using document root <none> and password file <none>
I20260619 06:43:18.512264 30680 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:18.512418 30680 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:18.512741 30680 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:18.515837 30680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "c65f960947ea4ee9bbcaf139f9a044ad"
format_stamp: "Formatted at 2026-06-19 06:43:18 on dist-test-slave-7lz4"
server_key: "74bee970743b5424729a666376cf562b"
server_key_iv: "3834bec789b851e3ad08e39e09bc4c52"
server_key_version: "encryptionkey@0"
I20260619 06:43:18.516688 30680 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "c65f960947ea4ee9bbcaf139f9a044ad"
format_stamp: "Formatted at 2026-06-19 06:43:18 on dist-test-slave-7lz4"
server_key: "74bee970743b5424729a666376cf562b"
server_key_iv: "3834bec789b851e3ad08e39e09bc4c52"
server_key_version: "encryptionkey@0"
I20260619 06:43:18.522212 30680 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 06:43:18.526088 30695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:18.527506 30680 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260619 06:43:18.527776 30680 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "c65f960947ea4ee9bbcaf139f9a044ad"
format_stamp: "Formatted at 2026-06-19 06:43:18 on dist-test-slave-7lz4"
server_key: "74bee970743b5424729a666376cf562b"
server_key_iv: "3834bec789b851e3ad08e39e09bc4c52"
server_key_version: "encryptionkey@0"
I20260619 06:43:18.528013 30680 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:18.552762 30680 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:18.557380 30680 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:18.557703 30680 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:18.558820 30680 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:43:18.560304 30680 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:43:18.560406 30680 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:18.560555 30680 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:43:18.560626 30680 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:18.572712 30540 heartbeater.cc:503] Master 127.10.192.126:39167 was elected leader, sending a full tablet report...
I20260619 06:43:18.596108 30680 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:42281
I20260619 06:43:18.596217 30807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:42281 every 8 connection(s)
I20260619 06:43:18.597687 30680 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:43:18.605520 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 30680
I20260619 06:43:18.605721 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:43:18.606274 11009 external_mini_cluster.cc:1428] Setting key 5e94c35a5e117e0e58b04c495ce57c01
Jun 19 06:43:18 dist-test-slave-7lz4 krb5kdc[30306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851398, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.67@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:43:18.619587 30810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:18.600662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:46711 (local address 127.10.192.126:39167)
0619 06:43:18.601194 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:18.601201 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:18.602230 (+ 1029us) server_negotiation.cc:407] Connection header received
0619 06:43:18.604247 (+ 2017us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:18.604253 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:18.604337 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:18.604445 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:18.606610 (+ 2165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.607495 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.609270 (+ 1775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.609731 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.609834 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:18.613547 (+ 3713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:18.613553 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:18.613556 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:18.613593 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:18.616393 (+ 2800us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:18.617219 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:18.617225 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:18.617227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:18.617364 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:18.617886 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:18.617890 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:18.617892 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:18.618192 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:18.618319 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:18.619023 (+ 704us) server_negotiation.cc:299] Negotiation successful
0619 06:43:18.619215 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":257,"threads_started":1}
I20260619 06:43:18.620855 30811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:18.601234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:39167 (local address 127.10.192.67:46711)
0619 06:43:18.602039 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:18.602087 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:18.603956 (+ 1869us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:18.604678 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:18.604686 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:18.605444 (+ 758us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:43:18.606386 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:18.606415 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.607702 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.607707 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:18.609097 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:18.609113 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.609938 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.609943 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:18.610160 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:18.610890 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:43:18.610919 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:43:18.613294 (+ 2375us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:43:18.616557 (+ 3263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:18.616564 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:18.616579 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:18.617070 (+ 491us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:18.617516 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:18.617520 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:18.617523 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:18.617732 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:18.618308 (+ 576us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:43:18.618313 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:43:18.618666 (+ 353us) client_negotiation.cc:769] Sending connection context
0619 06:43:18.618908 (+ 242us) client_negotiation.cc:240] Negotiation successful
0619 06:43:18.619356 (+ 448us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":310,"threads_started":1}
I20260619 06:43:18.622709 30808 heartbeater.cc:347] Connected to a master server at 127.10.192.126:39167
I20260619 06:43:18.623060 30808 heartbeater.cc:464] Registering TS with master...
I20260619 06:43:18.623922 30808 heartbeater.cc:511] Master 127.10.192.126:39167 requested a full tablet report, sending...
I20260619 06:43:18.625623 30350 ts_manager.cc:194] Registered new tserver with Master: c65f960947ea4ee9bbcaf139f9a044ad (127.10.192.67:42281)
I20260619 06:43:18.626626 30350 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.192.67@KRBTEST.COM'} at 127.10.192.67:46711
I20260619 06:43:18.635412 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 06:43:18.653241 30810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:18.639785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43720 (local address 127.10.192.126:39167)
0619 06:43:18.640033 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:18.640042 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:18.640471 (+ 429us) server_negotiation.cc:407] Connection header received
0619 06:43:18.640634 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:18.640639 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:18.640705 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:18.640789 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:18.642334 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.643129 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.644538 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.644946 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.645056 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:18.647446 (+ 2390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:18.647452 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:18.647455 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:18.647493 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:18.650304 (+ 2811us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:18.651019 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:18.651023 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:18.651025 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:18.651162 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:18.651690 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:18.651698 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:18.651702 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:18.652111 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:18.652310 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:18.652634 (+ 324us) server_negotiation.cc:299] Negotiation successful
0619 06:43:18.652868 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 06:43:18.657795 30350 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43720:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:43:18.665148 30350 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:43:18.702199 30821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:18.678391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:37803 (local address 127.0.0.1:37524)
0619 06:43:18.692150 (+ 13759us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:18.692178 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:18.692955 (+ 777us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:18.693800 (+ 845us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:18.693810 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:18.693846 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:18.694281 (+ 435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:18.694301 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.696369 (+ 2068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.696375 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:18.698895 (+ 2520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:18.698910 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.701153 (+ 2243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.701160 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:18.701367 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:18.701437 (+ 70us) client_negotiation.cc:769] Sending connection context
0619 06:43:18.701566 (+ 129us) client_negotiation.cc:240] Negotiation successful
0619 06:43:18.701768 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13552,"mutex_wait_us":1,"thread_start_us":13106,"threads_started":1}
I20260619 06:43:18.702271 30824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:18.678582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37524 (local address 127.10.192.66:37803)
0619 06:43:18.691036 (+ 12454us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:18.691050 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:18.692346 (+ 1296us) server_negotiation.cc:407] Connection header received
0619 06:43:18.693210 (+ 864us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:18.693219 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:18.693507 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:18.693717 (+ 210us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:18.694483 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.696201 (+ 1718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.699101 (+ 2900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.700619 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.700768 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:18.700993 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:18.701755 (+ 762us) server_negotiation.cc:299] Negotiation successful
0619 06:43:18.701954 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12173,"thread_start_us":12481,"threads_started":1}
I20260619 06:43:18.706133 30823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:18.677893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:46081 (local address 127.0.0.1:58772)
0619 06:43:18.691978 (+ 14085us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:18.692021 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:18.692252 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:18.693821 (+ 1569us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:18.693830 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:18.693868 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:18.694510 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:18.694525 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.699024 (+ 4499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.699028 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:18.701245 (+ 2217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:18.701301 (+ 56us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.705239 (+ 3938us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.705246 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:18.705436 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:18.705472 (+ 36us) client_negotiation.cc:769] Sending connection context
0619 06:43:18.705546 (+ 74us) client_negotiation.cc:240] Negotiation successful
0619 06:43:18.705691 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13792,"mutex_wait_us":3,"thread_start_us":14496,"threads_started":1}
I20260619 06:43:18.707279 30822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:18.678219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58772 (local address 127.10.192.65:46081)
0619 06:43:18.692989 (+ 14770us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:18.692999 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:18.693036 (+ 37us) server_negotiation.cc:407] Connection header received
0619 06:43:18.693174 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:18.693187 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:18.693527 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:18.694556 (+ 1029us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:18.694811 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.698905 (+ 4094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.701589 (+ 2684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.704980 (+ 3391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.706389 (+ 1409us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:18.706658 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:18.706745 (+ 87us) server_negotiation.cc:299] Negotiation successful
0619 06:43:18.706949 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14584,"thread_start_us":14381,"threads_started":1}
I20260619 06:43:18.706830 30609 tablet_service.cc:1467] Processing CreateTablet for tablet aa2700c720b64d71a90c6b23fd06bbac (DEFAULT_TABLE table=test-table [id=e2125f6473204f2c9e367165b121c9c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:43:18.708802 30609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa2700c720b64d71a90c6b23fd06bbac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:18.711350 30475 tablet_service.cc:1467] Processing CreateTablet for tablet aa2700c720b64d71a90c6b23fd06bbac (DEFAULT_TABLE table=test-table [id=e2125f6473204f2c9e367165b121c9c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:43:18.712054 30826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:18.694882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:42281 (local address 127.0.0.1:60164)
0619 06:43:18.698662 (+ 3780us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:18.698678 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:18.698839 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:18.699566 (+ 727us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:18.699571 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:18.699603 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:18.700193 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:18.700207 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.704064 (+ 3857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.704071 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:18.708852 (+ 4781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:18.708873 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.711152 (+ 2279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.711159 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:18.711363 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:18.711404 (+ 41us) client_negotiation.cc:769] Sending connection context
0619 06:43:18.711491 (+ 87us) client_negotiation.cc:240] Negotiation successful
0619 06:43:18.711664 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3646,"mutex_wait_us":55,"thread_start_us":3495,"threads_started":1}
I20260619 06:43:18.712860 30825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:18.692834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60164 (local address 127.10.192.67:42281)
0619 06:43:18.698356 (+ 5522us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:18.698368 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:18.698804 (+ 436us) server_negotiation.cc:407] Connection header received
0619 06:43:18.699022 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:18.699030 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:18.699335 (+ 305us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:18.699541 (+ 206us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:18.700396 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.703847 (+ 3451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.709123 (+ 5276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.710644 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.710781 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:18.711009 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:18.712325 (+ 1316us) server_negotiation.cc:299] Negotiation successful
0619 06:43:18.712509 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5329,"thread_start_us":5172,"threads_started":1}
I20260619 06:43:18.713148 30475 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa2700c720b64d71a90c6b23fd06bbac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:18.716821 30743 tablet_service.cc:1467] Processing CreateTablet for tablet aa2700c720b64d71a90c6b23fd06bbac (DEFAULT_TABLE table=test-table [id=e2125f6473204f2c9e367165b121c9c9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:43:18.718639 30743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa2700c720b64d71a90c6b23fd06bbac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:18.721993 30827 tablet_bootstrap.cc:492] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4: Bootstrap starting.
I20260619 06:43:18.725982 30827 tablet_bootstrap.cc:654] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:18.727052 30827 log.cc:824] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:18.729831 30829 tablet_bootstrap.cc:492] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269: Bootstrap starting.
I20260619 06:43:18.730346 30827 tablet_bootstrap.cc:492] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4: No bootstrap required, opened a new log
I20260619 06:43:18.730635 30827 ts_tablet_manager.cc:1397] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.003s
I20260619 06:43:18.734110 30829 tablet_bootstrap.cc:654] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:18.734529 30830 tablet_bootstrap.cc:492] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad: Bootstrap starting.
I20260619 06:43:18.735503 30829 log.cc:824] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:18.738296 30830 tablet_bootstrap.cc:654] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:18.739009 30829 tablet_bootstrap.cc:492] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269: No bootstrap required, opened a new log
I20260619 06:43:18.739316 30829 ts_tablet_manager.cc:1397] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.003s
I20260619 06:43:18.739450 30830 log.cc:824] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:18.742435 30830 tablet_bootstrap.cc:492] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad: No bootstrap required, opened a new log
I20260619 06:43:18.742731 30830 ts_tablet_manager.cc:1397] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260619 06:43:18.742547 30827 raft_consensus.cc:348] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649410b23c5f4dda803ccff46bc27269" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46081 } } peers { permanent_uuid: "d35d3ca7908249679ca37f74c0fa72d4" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 37803 } } peers { permanent_uuid: "c65f960947ea4ee9bbcaf139f9a044ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 42281 } }
I20260619 06:43:18.743019 30827 raft_consensus.cc:374] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:18.743114 30827 raft_consensus.cc:729] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d35d3ca7908249679ca37f74c0fa72d4, State: Initialized, Role: FOLLOWER
I20260619 06:43:18.743825 30827 consensus_queue.cc:260] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649410b23c5f4dda803ccff46bc27269" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46081 } } peers { permanent_uuid: "d35d3ca7908249679ca37f74c0fa72d4" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 37803 } } peers { permanent_uuid: "c65f960947ea4ee9bbcaf139f9a044ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 42281 } }
I20260619 06:43:18.748432 30674 heartbeater.cc:503] Master 127.10.192.126:39167 was elected leader, sending a full tablet report...
I20260619 06:43:18.749246 30827 ts_tablet_manager.cc:1428] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4: Time spent starting tablet: real 0.018s user 0.017s sys 0.000s
I20260619 06:43:18.750993 30829 raft_consensus.cc:348] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649410b23c5f4dda803ccff46bc27269" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46081 } } peers { permanent_uuid: "d35d3ca7908249679ca37f74c0fa72d4" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 37803 } } peers { permanent_uuid: "c65f960947ea4ee9bbcaf139f9a044ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 42281 } }
I20260619 06:43:18.751493 30829 raft_consensus.cc:374] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:18.751343 30830 raft_consensus.cc:348] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649410b23c5f4dda803ccff46bc27269" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46081 } } peers { permanent_uuid: "d35d3ca7908249679ca37f74c0fa72d4" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 37803 } } peers { permanent_uuid: "c65f960947ea4ee9bbcaf139f9a044ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 42281 } }
I20260619 06:43:18.751598 30829 raft_consensus.cc:729] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 649410b23c5f4dda803ccff46bc27269, State: Initialized, Role: FOLLOWER
I20260619 06:43:18.751813 30830 raft_consensus.cc:374] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:18.751935 30830 raft_consensus.cc:729] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c65f960947ea4ee9bbcaf139f9a044ad, State: Initialized, Role: FOLLOWER
I20260619 06:43:18.752444 30829 consensus_queue.cc:260] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649410b23c5f4dda803ccff46bc27269" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46081 } } peers { permanent_uuid: "d35d3ca7908249679ca37f74c0fa72d4" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 37803 } } peers { permanent_uuid: "c65f960947ea4ee9bbcaf139f9a044ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 42281 } }
I20260619 06:43:18.752522 30830 consensus_queue.cc:260] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649410b23c5f4dda803ccff46bc27269" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46081 } } peers { permanent_uuid: "d35d3ca7908249679ca37f74c0fa72d4" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 37803 } } peers { permanent_uuid: "c65f960947ea4ee9bbcaf139f9a044ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 42281 } }
I20260619 06:43:18.754079 30808 heartbeater.cc:503] Master 127.10.192.126:39167 was elected leader, sending a full tablet report...
I20260619 06:43:18.754779 30830 ts_tablet_manager.cc:1428] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260619 06:43:18.755795 30829 ts_tablet_manager.cc:1428] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269: Time spent starting tablet: real 0.016s user 0.013s sys 0.004s
I20260619 06:43:18.764868 30835 raft_consensus.cc:482] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:43:18.765174 30835 raft_consensus.cc:504] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649410b23c5f4dda803ccff46bc27269" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46081 } } peers { permanent_uuid: "d35d3ca7908249679ca37f74c0fa72d4" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 37803 } } peers { permanent_uuid: "c65f960947ea4ee9bbcaf139f9a044ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 42281 } }
I20260619 06:43:18.766902 30835 leader_election.cc:288] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 649410b23c5f4dda803ccff46bc27269 (127.10.192.65:46081), d35d3ca7908249679ca37f74c0fa72d4 (127.10.192.66:37803)
I20260619 06:43:18.774204 30811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:18.767438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:37803 (local address 127.10.192.67:60219)
0619 06:43:18.767611 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:18.767656 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:18.767792 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:18.768231 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:18.768237 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:18.768281 (+ 44us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:18.768512 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:18.768532 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.769812 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.769815 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:18.771869 (+ 2054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:18.771886 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.773383 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.773390 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:18.773594 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:18.773622 (+ 28us) client_negotiation.cc:769] Sending connection context
0619 06:43:18.773732 (+ 110us) client_negotiation.cc:240] Negotiation successful
0619 06:43:18.773870 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":47}
I20260619 06:43:18.774461 30824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:18.767426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:60219 (local address 127.10.192.66:37803)
0619 06:43:18.767656 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:18.767662 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:18.767739 (+ 77us) server_negotiation.cc:407] Connection header received
0619 06:43:18.767943 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:18.767951 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:18.768068 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:18.768191 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:18.768653 (+ 462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.769667 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.772075 (+ 2408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.773226 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.773409 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:18.773490 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:18.773773 (+ 283us) server_negotiation.cc:299] Negotiation successful
0619 06:43:18.773904 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260619 06:43:18.775154 30822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:18.767354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:33391 (local address 127.10.192.65:46081)
0619 06:43:18.767584 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:18.767592 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:18.768506 (+ 914us) server_negotiation.cc:407] Connection header received
0619 06:43:18.768665 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:18.768670 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:18.768750 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:18.768849 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:18.769341 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.770182 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.772447 (+ 2265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.773713 (+ 1266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.773876 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:18.773943 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:18.774722 (+ 779us) server_negotiation.cc:299] Negotiation successful
0619 06:43:18.774882 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260619 06:43:18.775161 30836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:18.767438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:46081 (local address 127.10.192.67:33391)
0619 06:43:18.768392 (+ 954us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:18.768410 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:18.768531 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:18.768863 (+ 332us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:18.768865 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:18.768884 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:18.769185 (+ 301us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:18.769193 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.770326 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.770331 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:18.772282 (+ 1951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:18.772292 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.774107 (+ 1815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.774114 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:18.774412 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:18.774449 (+ 37us) client_negotiation.cc:769] Sending connection context
0619 06:43:18.774671 (+ 222us) client_negotiation.cc:240] Negotiation successful
0619 06:43:18.774818 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":837,"mutex_wait_us":211,"thread_start_us":404,"threads_started":1}
I20260619 06:43:18.775529 30629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa2700c720b64d71a90c6b23fd06bbac" candidate_uuid: "c65f960947ea4ee9bbcaf139f9a044ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d35d3ca7908249679ca37f74c0fa72d4" is_pre_election: true
I20260619 06:43:18.776114 30629 raft_consensus.cc:2454] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65f960947ea4ee9bbcaf139f9a044ad in term 0.
I20260619 06:43:18.776147 30495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa2700c720b64d71a90c6b23fd06bbac" candidate_uuid: "c65f960947ea4ee9bbcaf139f9a044ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "649410b23c5f4dda803ccff46bc27269" is_pre_election: true
I20260619 06:43:18.776746 30495 raft_consensus.cc:2454] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c65f960947ea4ee9bbcaf139f9a044ad in term 0.
I20260619 06:43:18.776813 30698 leader_election.cc:302] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c65f960947ea4ee9bbcaf139f9a044ad, d35d3ca7908249679ca37f74c0fa72d4; no voters:
I20260619 06:43:18.777222 30835 raft_consensus.cc:2781] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:43:18.777355 30835 raft_consensus.cc:482] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:43:18.777442 30835 raft_consensus.cc:3037] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:18.779901 30835 raft_consensus.cc:504] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649410b23c5f4dda803ccff46bc27269" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46081 } } peers { permanent_uuid: "d35d3ca7908249679ca37f74c0fa72d4" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 37803 } } peers { permanent_uuid: "c65f960947ea4ee9bbcaf139f9a044ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 42281 } }
I20260619 06:43:18.780570 30835 leader_election.cc:288] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [CANDIDATE]: Term 1 election: Requested vote from peers 649410b23c5f4dda803ccff46bc27269 (127.10.192.65:46081), d35d3ca7908249679ca37f74c0fa72d4 (127.10.192.66:37803)
I20260619 06:43:18.781062 30629 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa2700c720b64d71a90c6b23fd06bbac" candidate_uuid: "c65f960947ea4ee9bbcaf139f9a044ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d35d3ca7908249679ca37f74c0fa72d4"
I20260619 06:43:18.781071 30495 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa2700c720b64d71a90c6b23fd06bbac" candidate_uuid: "c65f960947ea4ee9bbcaf139f9a044ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "649410b23c5f4dda803ccff46bc27269"
I20260619 06:43:18.781298 30495 raft_consensus.cc:3037] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:18.781306 30629 raft_consensus.cc:3037] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:18.783603 30495 raft_consensus.cc:2454] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65f960947ea4ee9bbcaf139f9a044ad in term 1.
I20260619 06:43:18.783601 30629 raft_consensus.cc:2454] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c65f960947ea4ee9bbcaf139f9a044ad in term 1.
I20260619 06:43:18.784205 30697 leader_election.cc:302] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 649410b23c5f4dda803ccff46bc27269, c65f960947ea4ee9bbcaf139f9a044ad; no voters:
I20260619 06:43:18.784590 30835 raft_consensus.cc:2781] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:18.785072 30835 raft_consensus.cc:686] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [term 1 LEADER]: Becoming Leader. State: Replica: c65f960947ea4ee9bbcaf139f9a044ad, State: Running, Role: LEADER
I20260619 06:43:18.785562 30835 consensus_queue.cc:237] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649410b23c5f4dda803ccff46bc27269" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46081 } } peers { permanent_uuid: "d35d3ca7908249679ca37f74c0fa72d4" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 37803 } } peers { permanent_uuid: "c65f960947ea4ee9bbcaf139f9a044ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 42281 } }
W20260619 06:43:18.789129 30541 tablet.cc:2369] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:43:18.790280 30351 catalog_manager.cc:5495] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad reported cstate change: term changed from 0 to 1, leader changed from <none> to c65f960947ea4ee9bbcaf139f9a044ad (127.10.192.67). New cstate: current_term: 1 leader_uuid: "c65f960947ea4ee9bbcaf139f9a044ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "649410b23c5f4dda803ccff46bc27269" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d35d3ca7908249679ca37f74c0fa72d4" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 37803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c65f960947ea4ee9bbcaf139f9a044ad" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 42281 } health_report { overall_health: HEALTHY } } }
I20260619 06:43:18.805979 30825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:18.800479 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60172 (local address 127.10.192.67:42281)
0619 06:43:18.800678 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:18.800687 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:18.800710 (+ 23us) server_negotiation.cc:407] Connection header received
0619 06:43:18.801014 (+ 304us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:18.801018 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:18.801115 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:18.801278 (+ 163us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:43:18.801658 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.802387 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.803833 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.804224 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.804367 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:18.804871 (+ 504us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:43:18.805397 (+ 526us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:43:18.805565 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:18.805625 (+ 60us) server_negotiation.cc:299] Negotiation successful
0619 06:43:18.805710 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
W20260619 06:43:18.814709 30675 tablet.cc:2369] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:43:18.814747 30495 raft_consensus.cc:1261] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269 [term 1 FOLLOWER]: Refusing update from remote peer c65f960947ea4ee9bbcaf139f9a044ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:43:18.814746 30629 raft_consensus.cc:1261] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4 [term 1 FOLLOWER]: Refusing update from remote peer c65f960947ea4ee9bbcaf139f9a044ad: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:43:18.815953 30837 consensus_queue.cc:1035] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "d35d3ca7908249679ca37f74c0fa72d4" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 37803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:43:18.816382 30835 consensus_queue.cc:1035] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "649410b23c5f4dda803ccff46bc27269" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:43:18.846707 30350 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:43:18.847002 30350 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:43:18.851194 30350 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c67b8f92aeaf428bac4f1fd637772a4e: Sending DeleteTablet for 3 replicas of tablet aa2700c720b64d71a90c6b23fd06bbac
I20260619 06:43:18.852581 30475 tablet_service.cc:1514] Processing DeleteTablet for tablet aa2700c720b64d71a90c6b23fd06bbac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:43:18 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:58772
I20260619 06:43:18.852628 30609 tablet_service.cc:1514] Processing DeleteTablet for tablet aa2700c720b64d71a90c6b23fd06bbac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:43:18 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:37524
I20260619 06:43:18.853961 30743 tablet_service.cc:1514] Processing DeleteTablet for tablet aa2700c720b64d71a90c6b23fd06bbac with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:43:18 UTC) from {username='kudu', principal='kudu/127.10.192.126@KRBTEST.COM'} at 127.0.0.1:60164
I20260619 06:43:18.857534 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 30412
I20260619 06:43:18.865193 30850 tablet_replica.cc:330] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4: stopping tablet replica
I20260619 06:43:18.865808 30850 raft_consensus.cc:2229] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:43:18.866442 30850 raft_consensus.cc:2258] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:43:18.867476 30849 tablet_replica.cc:330] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269: stopping tablet replica
I20260619 06:43:18.868053 30849 raft_consensus.cc:2229] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:43:18.868644 30849 raft_consensus.cc:2258] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:43:18.869167 30850 ts_tablet_manager.cc:1905] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:43:18.870189 30851 tablet_replica.cc:330] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad: stopping tablet replica
I20260619 06:43:18.870631 30851 raft_consensus.cc:2229] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:43:18.871464 30851 raft_consensus.cc:2258] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:43:18.873423 30851 ts_tablet_manager.cc:1905] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:43:18.874212 30849 ts_tablet_manager.cc:1905] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:43:18.876541 30850 ts_tablet_manager.cc:1918] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:43:18.876724 30850 log.cc:1196] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/aa2700c720b64d71a90c6b23fd06bbac
I20260619 06:43:18.877298 30850 ts_tablet_manager.cc:1939] T aa2700c720b64d71a90c6b23fd06bbac P d35d3ca7908249679ca37f74c0fa72d4: Deleting consensus metadata
I20260619 06:43:18.879460 30337 catalog_manager.cc:4841] TS d35d3ca7908249679ca37f74c0fa72d4 (127.10.192.66:37803): tablet aa2700c720b64d71a90c6b23fd06bbac (table test-table [id=e2125f6473204f2c9e367165b121c9c9]) successfully deleted
I20260619 06:43:18.881242 30851 ts_tablet_manager.cc:1918] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:43:18.881484 30851 log.cc:1196] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/aa2700c720b64d71a90c6b23fd06bbac
I20260619 06:43:18.882105 30851 ts_tablet_manager.cc:1939] T aa2700c720b64d71a90c6b23fd06bbac P c65f960947ea4ee9bbcaf139f9a044ad: Deleting consensus metadata
I20260619 06:43:18.884177 30337 catalog_manager.cc:4841] TS c65f960947ea4ee9bbcaf139f9a044ad (127.10.192.67:42281): tablet aa2700c720b64d71a90c6b23fd06bbac (table test-table [id=e2125f6473204f2c9e367165b121c9c9]) successfully deleted
Jun 19 06:43:18 dist-test-slave-7lz4 krb5kdc[30306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851396, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.65@KRBTEST.COM
I20260619 06:43:18.887460 30849 ts_tablet_manager.cc:1918] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:43:18.887668 30849 log.cc:1196] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/aa2700c720b64d71a90c6b23fd06bbac
I20260619 06:43:18.888234 30849 ts_tablet_manager.cc:1939] T aa2700c720b64d71a90c6b23fd06bbac P 649410b23c5f4dda803ccff46bc27269: Deleting consensus metadata
I20260619 06:43:18.890226 30336 catalog_manager.cc:4841] TS 649410b23c5f4dda803ccff46bc27269 (127.10.192.65:46081): tablet aa2700c720b64d71a90c6b23fd06bbac (table test-table [id=e2125f6473204f2c9e367165b121c9c9]) successfully deleted
I20260619 06:43:18.893347 30822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:18.858867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58786 (local address 127.10.192.65:46081)
0619 06:43:18.859306 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:18.859315 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:18.869467 (+ 10152us) server_negotiation.cc:407] Connection header received
0619 06:43:18.869703 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:18.869709 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:18.869807 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:18.869928 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:18.874463 (+ 4535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.875584 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.879864 (+ 4280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:18.880542 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:18.880659 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:18.886314 (+ 5655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:18.886327 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:18.886341 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:18.886381 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:18.889810 (+ 3429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:18.890995 (+ 1185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:18.891006 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:18.891010 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:18.891177 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:18.891593 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:18.891598 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:18.891602 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:18.892054 (+ 452us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:18.892379 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:18.892710 (+ 331us) server_negotiation.cc:299] Negotiation successful
0619 06:43:18.892955 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264}
I20260619 06:43:18.894196 30535 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:18.989321 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 30412
I20260619 06:43:19.008603 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 30546
Jun 19 06:43:19 dist-test-slave-7lz4 krb5kdc[30306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851396, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.66@KRBTEST.COM
I20260619 06:43:19.027480 30824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:19.009449 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37534 (local address 127.10.192.66:37803)
0619 06:43:19.009642 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:19.009646 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:19.009665 (+ 19us) server_negotiation.cc:407] Connection header received
0619 06:43:19.009863 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:19.009867 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:19.009962 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:19.010047 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:19.011887 (+ 1840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:19.012630 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:19.014497 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:19.014878 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:19.014991 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:19.020407 (+ 5416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:19.020440 (+ 33us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:19.020464 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:19.020520 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:19.024381 (+ 3861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:19.025242 (+ 861us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:19.025253 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:19.025257 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:19.025440 (+ 183us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:19.025813 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:19.025818 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:19.025821 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:19.026308 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:19.026628 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:19.026849 (+ 221us) server_negotiation.cc:299] Negotiation successful
0619 06:43:19.027095 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 06:43:19.028347 30669 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:19.139767 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 30546
I20260619 06:43:19.157536 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 30680
Jun 19 06:43:19 dist-test-slave-7lz4 krb5kdc[30306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851396, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.67@KRBTEST.COM
I20260619 06:43:19.176506 30825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:19.158416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60182 (local address 127.10.192.67:42281)
0619 06:43:19.158596 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:19.158600 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:19.158638 (+ 38us) server_negotiation.cc:407] Connection header received
0619 06:43:19.158858 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:19.158862 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:19.158935 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:19.159021 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:19.160889 (+ 1868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:19.161711 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:19.163625 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:19.164144 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:19.164251 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:19.170021 (+ 5770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:19.170033 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:19.170049 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:19.170102 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:19.173317 (+ 3215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:19.174189 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:19.174197 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:19.174199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:19.174361 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:19.174798 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:19.174801 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:19.174803 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:19.175158 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:19.175396 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:19.175968 (+ 572us) server_negotiation.cc:299] Negotiation successful
0619 06:43:19.176152 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260619 06:43:19.177292 30803 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:19.303381 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 30680
I20260619 06:43:19.323827 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 30319
I20260619 06:43:19.324970 30381 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:19.438679 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 30319
2026-06-19T06:43:19Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4403 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-06-19T06:43:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:19Z Disabled control of system clock
I20260619 06:43:19.518303 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:45061
--webserver_interface=127.10.192.126
--webserver_port=0
--builtin_ntp_servers=127.10.192.84:36259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:45061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260619 06:43:19.863811 30860 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:19.864226 30860 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:19.864318 30860 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:19.871883 30860 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:19.872015 30860 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:19.872053 30860 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:19.872104 30860 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:19.872148 30860 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:19.881752 30860 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:36259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:45061
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:45061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:19.883157 30860 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:19.885218 30860 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:19.897889 30866 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:19.897929 30868 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:19.897871 30865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:19.898792 30860 server_base.cc:1034] running on GCE node
I20260619 06:43:19.899724 30860 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:19.901218 30860 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:19.902427 30860 hybrid_clock.cc:648] HybridClock initialized: now 1781851399902384 us; error 34 us; skew 500 ppm
I20260619 06:43:19.902757 30860 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:43:19.905159 30860 webserver.cc:460] Webserver started at http://127.10.192.126:42127/ using document root <none> and password file <none>
I20260619 06:43:19.905858 30860 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:19.905957 30860 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:19.906234 30860 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:19.909348 30860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "fd739cd6c7864ffa9537a1af3b31dda5"
format_stamp: "Formatted at 2026-06-19 06:43:19 on dist-test-slave-7lz4"
server_key: "64e28e72b41c6019c8c3e76066445802"
server_key_iv: "1138f2bfbb3b47d27c86301ea4226300"
server_key_version: "encryptionkey@0"
I20260619 06:43:19.910192 30860 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "fd739cd6c7864ffa9537a1af3b31dda5"
format_stamp: "Formatted at 2026-06-19 06:43:19 on dist-test-slave-7lz4"
server_key: "64e28e72b41c6019c8c3e76066445802"
server_key_iv: "1138f2bfbb3b47d27c86301ea4226300"
server_key_version: "encryptionkey@0"
I20260619 06:43:19.916114 30860 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260619 06:43:19.920750 30874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:19.922207 30860 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:43:19.922363 30860 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "fd739cd6c7864ffa9537a1af3b31dda5"
format_stamp: "Formatted at 2026-06-19 06:43:19 on dist-test-slave-7lz4"
server_key: "64e28e72b41c6019c8c3e76066445802"
server_key_iv: "1138f2bfbb3b47d27c86301ea4226300"
server_key_version: "encryptionkey@0"
I20260619 06:43:19.922551 30860 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:19.944283 30860 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:19.945153 30860 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:19.945403 30860 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:19.965233 30860 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:45061
I20260619 06:43:19.965233 30925 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:45061 every 8 connection(s)
I20260619 06:43:19.966765 30860 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:19.970721 30926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:19.976405 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 30860
I20260619 06:43:19.976629 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:19.977097 11009 external_mini_cluster.cc:1428] Setting key 4ec8a4589e364a33e2e9cd4a4c6e7228
I20260619 06:43:19.982424 30926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5: Bootstrap starting.
I20260619 06:43:19.985873 30926 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:19.986964 30926 log.cc:824] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:19.990288 30926 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5: No bootstrap required, opened a new log
I20260619 06:43:19.991483 30929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:19.979119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46822 (local address 127.10.192.126:45061)
0619 06:43:19.980297 (+ 1178us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:19.980309 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:19.980357 (+ 48us) server_negotiation.cc:407] Connection header received
0619 06:43:19.982112 (+ 1755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:19.982134 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:19.982662 (+ 528us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:19.983092 (+ 430us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:19.983738 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:19.985078 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:19.986517 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:19.987509 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:19.987753 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:19.989013 (+ 1260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:19.989021 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:19.989036 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:19.989606 (+ 570us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:19.989690 (+ 84us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:19.989712 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:19.989849 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:19.990078 (+ 229us) server_negotiation.cc:299] Negotiation successful
0619 06:43:19.990435 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":712,"thread_start_us":448,"threads_started":1}
I20260619 06:43:19.999946 30926 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd739cd6c7864ffa9537a1af3b31dda5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 45061 } }
I20260619 06:43:20.000371 30926 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:20.000483 30926 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd739cd6c7864ffa9537a1af3b31dda5, State: Initialized, Role: FOLLOWER
I20260619 06:43:20.001212 30926 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd739cd6c7864ffa9537a1af3b31dda5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 45061 } }
I20260619 06:43:20.001523 30926 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:20.001680 30926 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:20.001883 30926 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:20.004232 30926 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd739cd6c7864ffa9537a1af3b31dda5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 45061 } }
I20260619 06:43:20.004791 30926 leader_election.cc:302] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd739cd6c7864ffa9537a1af3b31dda5; no voters:
I20260619 06:43:20.005383 30926 leader_election.cc:288] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:20.005564 30931 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:20.006275 30931 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5 [term 1 LEADER]: Becoming Leader. State: Replica: fd739cd6c7864ffa9537a1af3b31dda5, State: Running, Role: LEADER
I20260619 06:43:20.006819 30931 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd739cd6c7864ffa9537a1af3b31dda5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 45061 } }
I20260619 06:43:20.007575 30926 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:20.009615 30932 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd739cd6c7864ffa9537a1af3b31dda5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd739cd6c7864ffa9537a1af3b31dda5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 45061 } } }
I20260619 06:43:20.010018 30933 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd739cd6c7864ffa9537a1af3b31dda5. Latest consensus state: current_term: 1 leader_uuid: "fd739cd6c7864ffa9537a1af3b31dda5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd739cd6c7864ffa9537a1af3b31dda5" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 45061 } } }
I20260619 06:43:20.010449 30932 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:20.010449 30933 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:20.011703 30938 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:20.017165 30938 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:20.027535 30938 catalog_manager.cc:1347] Generated new cluster ID: c223cc8e531e4e73b0b4f05b83176d0e
I20260619 06:43:20.027835 30938 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:20.043378 30938 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:20.044766 30938 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:20.052260 30938 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5: Generated new TSK 0
I20260619 06:43:20.053165 30938 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:20.062572 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.65:0
--local_ip_for_outbound_sockets=127.10.192.65
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:45061
--builtin_ntp_servers=127.10.192.84:36259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260619 06:43:20.428030 30950 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:20.428349 30950 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:20.428512 30950 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:20.435914 30950 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:20.436030 30950 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:20.436221 30950 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.65
I20260619 06:43:20.445785 30950 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:36259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.65:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.10.192.65
--webserver_port=0
--tserver_master_addrs=127.10.192.126:45061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.65
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:20.447170 30950 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:20.449249 30950 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:20.462862 30958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:20.462891 30956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:20.462970 30955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:20.463703 30950 server_base.cc:1034] running on GCE node
I20260619 06:43:20.464377 30950 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:20.465284 30950 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:20.466490 30950 hybrid_clock.cc:648] HybridClock initialized: now 1781851400466440 us; error 41 us; skew 500 ppm
I20260619 06:43:20.466773 30950 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:43:20.469134 30950 webserver.cc:460] Webserver started at http://127.10.192.65:34077/ using document root <none> and password file <none>
I20260619 06:43:20.469774 30950 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:20.469913 30950 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:20.470188 30950 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:20.473173 30950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-0/data/instance:
uuid: "2ff62f6f41f14391bae7775b2f039171"
format_stamp: "Formatted at 2026-06-19 06:43:20 on dist-test-slave-7lz4"
server_key: "0e59a1a121afccea23b18547af9790aa"
server_key_iv: "f126cf2d8e0a556bf3c1198f6140e47c"
server_key_version: "encryptionkey@0"
I20260619 06:43:20.473948 30950 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance:
uuid: "2ff62f6f41f14391bae7775b2f039171"
format_stamp: "Formatted at 2026-06-19 06:43:20 on dist-test-slave-7lz4"
server_key: "0e59a1a121afccea23b18547af9790aa"
server_key_iv: "f126cf2d8e0a556bf3c1198f6140e47c"
server_key_version: "encryptionkey@0"
I20260619 06:43:20.479262 30950 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260619 06:43:20.482982 30964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:20.484453 30950 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:43:20.484649 30950 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-0/wal
uuid: "2ff62f6f41f14391bae7775b2f039171"
format_stamp: "Formatted at 2026-06-19 06:43:20 on dist-test-slave-7lz4"
server_key: "0e59a1a121afccea23b18547af9790aa"
server_key_iv: "f126cf2d8e0a556bf3c1198f6140e47c"
server_key_version: "encryptionkey@0"
I20260619 06:43:20.484903 30950 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:20.513671 30950 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:20.514638 30950 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:20.514983 30950 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:20.516198 30950 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:43:20.517769 30950 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:43:20.517866 30950 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:20.518023 30950 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:43:20.518127 30950 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:20.552139 30950 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.65:34761
I20260619 06:43:20.552196 31076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.65:34761 every 8 connection(s)
I20260619 06:43:20.553573 30950 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-0/data/info.pb
I20260619 06:43:20.563277 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 30950
I20260619 06:43:20.563489 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-0/wal/instance
I20260619 06:43:20.564162 11009 external_mini_cluster.cc:1428] Setting key 24738b8b0b85e6c0099baf6d85bdba80
I20260619 06:43:20.567423 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:20.556244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.65:45737 (local address 127.10.192.126:45061)
0619 06:43:20.556718 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:20.556723 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:20.557916 (+ 1193us) server_negotiation.cc:407] Connection header received
0619 06:43:20.559812 (+ 1896us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:20.559818 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:20.559916 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:20.560038 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:20.561178 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:20.561987 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:20.563737 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:20.564501 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:20.564668 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:20.566442 (+ 1774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:20.566449 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:20.566454 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:20.566477 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:20.566531 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:20.566549 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:20.566659 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:20.566891 (+ 232us) server_negotiation.cc:299] Negotiation successful
0619 06:43:20.566997 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":374,"thread_start_us":260,"threads_started":1}
I20260619 06:43:20.567662 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.66:0
--local_ip_for_outbound_sockets=127.10.192.66
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:45061
--builtin_ntp_servers=127.10.192.84:36259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260619 06:43:20.568446 31080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:20.556809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:45061 (local address 127.10.192.65:45737)
0619 06:43:20.557746 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:20.557785 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:20.559478 (+ 1693us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:20.560290 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:20.560299 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:20.560397 (+ 98us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:43:20.560997 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:20.561019 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:20.562146 (+ 1127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:20.562156 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:20.563495 (+ 1339us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:20.563512 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:20.564782 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:20.564787 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:20.565158 (+ 371us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:20.565972 (+ 814us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:43:20.565976 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:43:20.566038 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:43:20.566175 (+ 137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:43:20.566666 (+ 491us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:43:20.566675 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:43:20.566682 (+ 7us) client_negotiation.cc:769] Sending connection context
0619 06:43:20.566842 (+ 160us) client_negotiation.cc:240] Negotiation successful
0619 06:43:20.567170 (+ 328us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":457,"thread_start_us":282,"threads_started":1}
I20260619 06:43:20.570024 31077 heartbeater.cc:347] Connected to a master server at 127.10.192.126:45061
I20260619 06:43:20.570339 31077 heartbeater.cc:464] Registering TS with master...
I20260619 06:43:20.571108 31077 heartbeater.cc:511] Master 127.10.192.126:45061 requested a full tablet report, sending...
I20260619 06:43:20.573266 30891 ts_manager.cc:194] Registered new tserver with Master: 2ff62f6f41f14391bae7775b2f039171 (127.10.192.65:34761)
I20260619 06:43:20.574751 30891 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.192.65:45737
W20260619 06:43:20.916868 31081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:20.917163 31081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:20.917249 31081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:20.926280 31081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:20.926430 31081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:20.926555 31081 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.66
I20260619 06:43:20.936342 31081 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:36259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.66:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.10.192.66
--webserver_port=0
--tserver_master_addrs=127.10.192.126:45061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.66
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:20.937680 31081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:20.939603 31081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:20.953635 31089 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:20.953657 31087 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:20.953594 31086 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:20.954355 31081 server_base.cc:1034] running on GCE node
I20260619 06:43:20.954962 31081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:20.956009 31081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:20.957214 31081 hybrid_clock.cc:648] HybridClock initialized: now 1781851400957161 us; error 46 us; skew 500 ppm
I20260619 06:43:20.957511 31081 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:43:20.959898 31081 webserver.cc:460] Webserver started at http://127.10.192.66:42019/ using document root <none> and password file <none>
I20260619 06:43:20.960575 31081 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:20.960661 31081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:20.960925 31081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:20.963990 31081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-1/data/instance:
uuid: "480d1bb62f8b4268879f84351e5f8788"
format_stamp: "Formatted at 2026-06-19 06:43:20 on dist-test-slave-7lz4"
server_key: "59cf04e8edaa7bcbc04f310f30bff899"
server_key_iv: "fdd99dd753b7c1605c7b08d5c53148a4"
server_key_version: "encryptionkey@0"
I20260619 06:43:20.964984 31081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance:
uuid: "480d1bb62f8b4268879f84351e5f8788"
format_stamp: "Formatted at 2026-06-19 06:43:20 on dist-test-slave-7lz4"
server_key: "59cf04e8edaa7bcbc04f310f30bff899"
server_key_iv: "fdd99dd753b7c1605c7b08d5c53148a4"
server_key_version: "encryptionkey@0"
I20260619 06:43:20.971784 31081 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260619 06:43:20.976493 31095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:20.978258 31081 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260619 06:43:20.978441 31081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-1/wal
uuid: "480d1bb62f8b4268879f84351e5f8788"
format_stamp: "Formatted at 2026-06-19 06:43:20 on dist-test-slave-7lz4"
server_key: "59cf04e8edaa7bcbc04f310f30bff899"
server_key_iv: "fdd99dd753b7c1605c7b08d5c53148a4"
server_key_version: "encryptionkey@0"
I20260619 06:43:20.978699 31081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:21.003286 31081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:21.004175 31081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:21.004446 31081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:21.005481 31081 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:43:21.006973 31081 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:43:21.007077 31081 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:21.007164 31081 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:43:21.007218 31081 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:21.041193 31081 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.66:36725
I20260619 06:43:21.041293 31207 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.66:36725 every 8 connection(s)
I20260619 06:43:21.042568 31081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-1/data/info.pb
I20260619 06:43:21.045580 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 31081
I20260619 06:43:21.045797 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-1/wal/instance
I20260619 06:43:21.046277 11009 external_mini_cluster.cc:1428] Setting key 73e52ec2c78051e1ea651b251a95d2b3
I20260619 06:43:21.049480 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.10.192.67:0
--local_ip_for_outbound_sockets=127.10.192.67
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:45061
--builtin_ntp_servers=127.10.192.84:36259
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260619 06:43:21.056885 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:21.045382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:40591 (local address 127.10.192.126:45061)
0619 06:43:21.045647 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:21.045656 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:21.047279 (+ 1623us) server_negotiation.cc:407] Connection header received
0619 06:43:21.049399 (+ 2120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:21.049404 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:21.049497 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:21.049618 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:21.050837 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.052063 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.053625 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.054354 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.054501 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:21.055943 (+ 1442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:21.055952 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:21.055960 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:21.055988 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:21.056033 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:21.056051 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:21.056151 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:21.056359 (+ 208us) server_negotiation.cc:299] Negotiation successful
0619 06:43:21.056475 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260619 06:43:21.057977 31210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:21.045988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:45061 (local address 127.10.192.66:40591)
0619 06:43:21.047105 (+ 1117us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:21.047153 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:21.049111 (+ 1958us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:21.049932 (+ 821us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:21.049942 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:21.050044 (+ 102us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:43:21.050652 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:21.050668 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.052208 (+ 1540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.052212 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:21.053472 (+ 1260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:21.053484 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.054570 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.054575 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:21.054787 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:21.055545 (+ 758us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:43:21.055548 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:43:21.055590 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:43:21.055735 (+ 145us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:43:21.056153 (+ 418us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:43:21.056161 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:43:21.056167 (+ 6us) client_negotiation.cc:769] Sending connection context
0619 06:43:21.056320 (+ 153us) client_negotiation.cc:240] Negotiation successful
0619 06:43:21.056655 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":549,"thread_start_us":359,"threads_started":1}
I20260619 06:43:21.059615 31208 heartbeater.cc:347] Connected to a master server at 127.10.192.126:45061
I20260619 06:43:21.059974 31208 heartbeater.cc:464] Registering TS with master...
I20260619 06:43:21.060716 31208 heartbeater.cc:511] Master 127.10.192.126:45061 requested a full tablet report, sending...
I20260619 06:43:21.062318 30891 ts_manager.cc:194] Registered new tserver with Master: 480d1bb62f8b4268879f84351e5f8788 (127.10.192.66:36725)
I20260619 06:43:21.063575 30891 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.192.66:40591
W20260619 06:43:21.389003 31211 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:21.389286 31211 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:21.389379 31211 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:21.396901 31211 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:21.397010 31211 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:21.397118 31211 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.192.67
I20260619 06:43:21.406433 31211 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:36259
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.10.192.67:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.10.192.67
--webserver_port=0
--tserver_master_addrs=127.10.192.126:45061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.10.192.67
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:21.407832 31211 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:21.409664 31211 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:21.423796 31216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:21.423744 31219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:21.423717 31217 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:21.424700 31211 server_base.cc:1034] running on GCE node
I20260619 06:43:21.425309 31211 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:21.426402 31211 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:21.427666 31211 hybrid_clock.cc:648] HybridClock initialized: now 1781851401427570 us; error 51 us; skew 500 ppm
I20260619 06:43:21.428020 31211 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260619 06:43:21.430373 31211 webserver.cc:460] Webserver started at http://127.10.192.67:34889/ using document root <none> and password file <none>
I20260619 06:43:21.431154 31211 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:21.431272 31211 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:21.431671 31211 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:21.434684 31211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-2/data/instance:
uuid: "223ff6276ef143e59a9a362846da101a"
format_stamp: "Formatted at 2026-06-19 06:43:21 on dist-test-slave-7lz4"
server_key: "183ed8ba425bd8717c8ac07b39d011d1"
server_key_iv: "9b6a187af9125e34d5a84495e6b1319a"
server_key_version: "encryptionkey@0"
I20260619 06:43:21.435516 31211 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance:
uuid: "223ff6276ef143e59a9a362846da101a"
format_stamp: "Formatted at 2026-06-19 06:43:21 on dist-test-slave-7lz4"
server_key: "183ed8ba425bd8717c8ac07b39d011d1"
server_key_iv: "9b6a187af9125e34d5a84495e6b1319a"
server_key_version: "encryptionkey@0"
I20260619 06:43:21.440933 31211 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260619 06:43:21.445078 31225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:21.446523 31211 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:43:21.446718 31211 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-2/wal
uuid: "223ff6276ef143e59a9a362846da101a"
format_stamp: "Formatted at 2026-06-19 06:43:21 on dist-test-slave-7lz4"
server_key: "183ed8ba425bd8717c8ac07b39d011d1"
server_key_iv: "9b6a187af9125e34d5a84495e6b1319a"
server_key_version: "encryptionkey@0"
I20260619 06:43:21.446952 31211 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:21.499104 31211 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:21.500062 31211 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:21.500391 31211 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:21.501417 31211 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260619 06:43:21.502981 31211 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260619 06:43:21.503108 31211 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:21.503252 31211 ts_tablet_manager.cc:610] Registered 0 tablets
I20260619 06:43:21.503348 31211 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:21.538146 31211 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.67:37631
I20260619 06:43:21.538298 31337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.67:37631 every 8 connection(s)
I20260619 06:43:21.539521 31211 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-2/data/info.pb
I20260619 06:43:21.548712 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 31211
I20260619 06:43:21.548905 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-2/wal/instance
I20260619 06:43:21.549360 11009 external_mini_cluster.cc:1428] Setting key 3214f2906871f25b56a0ea5113fa3bfb
I20260619 06:43:21.552845 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:21.542182 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.67:35227 (local address 127.10.192.126:45061)
0619 06:43:21.542372 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:21.542377 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:21.543828 (+ 1451us) server_negotiation.cc:407] Connection header received
0619 06:43:21.545736 (+ 1908us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:21.545741 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:21.545815 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:21.545909 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:21.546946 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.547802 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.549539 (+ 1737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.550048 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.550196 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:21.551966 (+ 1770us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:21.551973 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:21.551978 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:21.552000 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:21.552042 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:21.552056 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:21.552151 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:21.552396 (+ 245us) server_negotiation.cc:299] Negotiation successful
0619 06:43:21.552505 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260619 06:43:21.553895 31340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:21.542716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:45061 (local address 127.10.192.67:35227)
0619 06:43:21.543602 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:21.543696 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:21.545477 (+ 1781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:21.546124 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:21.546133 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:21.546222 (+ 89us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:43:21.546792 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:21.546807 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.547937 (+ 1130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.547941 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:21.549326 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:21.549340 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.550319 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.550326 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:21.550651 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:21.551500 (+ 849us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0619 06:43:21.551506 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:43:21.551573 (+ 67us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0619 06:43:21.551722 (+ 149us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:43:21.552162 (+ 440us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:43:21.552173 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:43:21.552181 (+ 8us) client_negotiation.cc:769] Sending connection context
0619 06:43:21.552385 (+ 204us) client_negotiation.cc:240] Negotiation successful
0619 06:43:21.552816 (+ 431us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":443,"thread_start_us":258,"threads_started":1}
I20260619 06:43:21.555334 31338 heartbeater.cc:347] Connected to a master server at 127.10.192.126:45061
I20260619 06:43:21.555681 31338 heartbeater.cc:464] Registering TS with master...
I20260619 06:43:21.556594 31338 heartbeater.cc:511] Master 127.10.192.126:45061 requested a full tablet report, sending...
I20260619 06:43:21.558177 30891 ts_manager.cc:194] Registered new tserver with Master: 223ff6276ef143e59a9a362846da101a (127.10.192.67:37631)
I20260619 06:43:21.558931 30891 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.10.192.67:35227
I20260619 06:43:21.565179 11009 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260619 06:43:21.575412 31079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:21.569550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46834 (local address 127.10.192.126:45061)
0619 06:43:21.569749 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:21.569754 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:21.570140 (+ 386us) server_negotiation.cc:407] Connection header received
0619 06:43:21.570280 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:21.570284 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:21.570349 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:21.570449 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:21.570878 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.571592 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.573047 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.573468 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.573610 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:21.574651 (+ 1041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:21.574656 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:21.574659 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:21.574678 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:21.574711 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:21.574723 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:21.574820 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:21.574987 (+ 167us) server_negotiation.cc:299] Negotiation successful
0619 06:43:21.575085 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260619 06:43:21.578127 31077 heartbeater.cc:503] Master 127.10.192.126:45061 was elected leader, sending a full tablet report...
I20260619 06:43:21.579439 30891 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46834:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260619 06:43:21.586989 30891 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260619 06:43:21.612639 31351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:21.600412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33808 (local address 127.10.192.67:37631)
0619 06:43:21.602633 (+ 2221us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:21.602648 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:21.602675 (+ 27us) server_negotiation.cc:407] Connection header received
0619 06:43:21.602752 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:21.602757 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:21.603037 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:21.604051 (+ 1014us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:21.604308 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.605300 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.609416 (+ 4116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.610914 (+ 1498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.611067 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:21.611391 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:21.612126 (+ 735us) server_negotiation.cc:299] Negotiation successful
0619 06:43:21.612327 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2060,"thread_start_us":1910,"threads_started":1}
I20260619 06:43:21.613353 31352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:21.600120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:37631 (local address 127.0.0.1:33808)
0619 06:43:21.601691 (+ 1571us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:21.601746 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:21.601959 (+ 213us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:21.603285 (+ 1326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:21.603293 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:21.603325 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:21.603825 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:21.603838 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.605447 (+ 1609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.605455 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:21.609202 (+ 3747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:21.609217 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.611551 (+ 2334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.611558 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:21.611812 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:21.611873 (+ 61us) client_negotiation.cc:769] Sending connection context
0619 06:43:21.612883 (+ 1010us) client_negotiation.cc:240] Negotiation successful
0619 06:43:21.613105 (+ 222us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1171,"mutex_wait_us":2,"thread_start_us":7002,"threads_started":1}
I20260619 06:43:21.614848 31354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:21.600625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34761 (local address 127.0.0.1:54316)
0619 06:43:21.605943 (+ 5318us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:21.605962 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:21.606080 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:21.607795 (+ 1715us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:21.607801 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:21.607831 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:21.608185 (+ 354us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:21.608196 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.610035 (+ 1839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.610043 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:21.611962 (+ 1919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:21.611983 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.614041 (+ 2058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.614047 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:21.614204 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:21.614241 (+ 37us) client_negotiation.cc:769] Sending connection context
0619 06:43:21.614323 (+ 82us) client_negotiation.cc:240] Negotiation successful
0619 06:43:21.614456 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5169,"mutex_wait_us":25,"thread_start_us":490,"threads_started":1}
I20260619 06:43:21.614950 31353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:21.601134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54316 (local address 127.10.192.65:34761)
0619 06:43:21.607057 (+ 5923us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:21.607067 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:21.607096 (+ 29us) server_negotiation.cc:407] Connection header received
0619 06:43:21.607209 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:21.607218 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:21.607537 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:21.608376 (+ 839us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:21.608625 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.609894 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.612202 (+ 2308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.613833 (+ 1631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.613999 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:21.614295 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:21.614370 (+ 75us) server_negotiation.cc:299] Negotiation successful
0619 06:43:21.614549 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5741,"thread_start_us":5612,"threads_started":1}
I20260619 06:43:21.615899 31350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:21.602097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.66:36725 (local address 127.0.0.1:36606)
0619 06:43:21.607406 (+ 5309us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:21.607452 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:21.607585 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:21.608353 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:21.608357 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:21.608384 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:21.608913 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:21.608926 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.610802 (+ 1876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.610807 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:21.612899 (+ 2092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:21.612915 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.615067 (+ 2152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.615074 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:21.615257 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:21.615334 (+ 77us) client_negotiation.cc:769] Sending connection context
0619 06:43:21.615434 (+ 100us) client_negotiation.cc:240] Negotiation successful
0619 06:43:21.615562 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5190,"mutex_wait_us":1,"thread_start_us":3533,"threads_started":1}
I20260619 06:43:21.616451 31355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:21.602353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36606 (local address 127.10.192.66:36725)
0619 06:43:21.606592 (+ 4239us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:21.606601 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:21.607718 (+ 1117us) server_negotiation.cc:407] Connection header received
0619 06:43:21.607980 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:21.607986 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:21.608166 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:21.608373 (+ 207us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:21.609142 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.610642 (+ 1500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.613128 (+ 2486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.614557 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.614695 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:21.614922 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:21.615689 (+ 767us) server_negotiation.cc:299] Negotiation successful
0619 06:43:21.615938 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4062,"thread_start_us":3953,"threads_started":1}
I20260619 06:43:21.618068 31273 tablet_service.cc:1467] Processing CreateTablet for tablet 221cf7abebd74eab8613ec6ee94bd8ff (DEFAULT_TABLE table=test-table [id=da3db878309a48299845faa14c2e17e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:43:21.618872 31012 tablet_service.cc:1467] Processing CreateTablet for tablet 221cf7abebd74eab8613ec6ee94bd8ff (DEFAULT_TABLE table=test-table [id=da3db878309a48299845faa14c2e17e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:43:21.619725 31273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 221cf7abebd74eab8613ec6ee94bd8ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:21.620128 31012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 221cf7abebd74eab8613ec6ee94bd8ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:21.620746 31143 tablet_service.cc:1467] Processing CreateTablet for tablet 221cf7abebd74eab8613ec6ee94bd8ff (DEFAULT_TABLE table=test-table [id=da3db878309a48299845faa14c2e17e7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260619 06:43:21.622087 31143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 221cf7abebd74eab8613ec6ee94bd8ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:21.633630 31356 tablet_bootstrap.cc:492] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171: Bootstrap starting.
I20260619 06:43:21.635879 31357 tablet_bootstrap.cc:492] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a: Bootstrap starting.
I20260619 06:43:21.637750 31356 tablet_bootstrap.cc:654] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:21.639173 31356 log.cc:824] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:21.639680 31357 tablet_bootstrap.cc:654] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:21.640516 31358 tablet_bootstrap.cc:492] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788: Bootstrap starting.
I20260619 06:43:21.641393 31357 log.cc:824] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:21.644433 31358 tablet_bootstrap.cc:654] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:21.644806 31356 tablet_bootstrap.cc:492] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171: No bootstrap required, opened a new log
I20260619 06:43:21.644802 31357 tablet_bootstrap.cc:492] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a: No bootstrap required, opened a new log
I20260619 06:43:21.645105 31357 ts_tablet_manager.cc:1397] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a: Time spent bootstrapping tablet: real 0.010s user 0.003s sys 0.004s
I20260619 06:43:21.645105 31356 ts_tablet_manager.cc:1397] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.004s
I20260619 06:43:21.645569 31358 log.cc:824] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:21.648327 31358 tablet_bootstrap.cc:492] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788: No bootstrap required, opened a new log
I20260619 06:43:21.648614 31358 ts_tablet_manager.cc:1397] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260619 06:43:21.656445 31358 raft_consensus.cc:348] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223ff6276ef143e59a9a362846da101a" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37631 } } peers { permanent_uuid: "2ff62f6f41f14391bae7775b2f039171" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34761 } } peers { permanent_uuid: "480d1bb62f8b4268879f84351e5f8788" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36725 } }
I20260619 06:43:21.656342 31356 raft_consensus.cc:348] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223ff6276ef143e59a9a362846da101a" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37631 } } peers { permanent_uuid: "2ff62f6f41f14391bae7775b2f039171" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34761 } } peers { permanent_uuid: "480d1bb62f8b4268879f84351e5f8788" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36725 } }
I20260619 06:43:21.656855 31358 raft_consensus.cc:374] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:21.656867 31356 raft_consensus.cc:374] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:21.656600 31357 raft_consensus.cc:348] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223ff6276ef143e59a9a362846da101a" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37631 } } peers { permanent_uuid: "2ff62f6f41f14391bae7775b2f039171" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34761 } } peers { permanent_uuid: "480d1bb62f8b4268879f84351e5f8788" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36725 } }
I20260619 06:43:21.656948 31358 raft_consensus.cc:729] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 480d1bb62f8b4268879f84351e5f8788, State: Initialized, Role: FOLLOWER
I20260619 06:43:21.656968 31356 raft_consensus.cc:729] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ff62f6f41f14391bae7775b2f039171, State: Initialized, Role: FOLLOWER
I20260619 06:43:21.657011 31357 raft_consensus.cc:374] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:21.657094 31357 raft_consensus.cc:729] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 223ff6276ef143e59a9a362846da101a, State: Initialized, Role: FOLLOWER
I20260619 06:43:21.657680 31358 consensus_queue.cc:260] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223ff6276ef143e59a9a362846da101a" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37631 } } peers { permanent_uuid: "2ff62f6f41f14391bae7775b2f039171" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34761 } } peers { permanent_uuid: "480d1bb62f8b4268879f84351e5f8788" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36725 } }
I20260619 06:43:21.657703 31356 consensus_queue.cc:260] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223ff6276ef143e59a9a362846da101a" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37631 } } peers { permanent_uuid: "2ff62f6f41f14391bae7775b2f039171" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34761 } } peers { permanent_uuid: "480d1bb62f8b4268879f84351e5f8788" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36725 } }
I20260619 06:43:21.657697 31357 consensus_queue.cc:260] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223ff6276ef143e59a9a362846da101a" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37631 } } peers { permanent_uuid: "2ff62f6f41f14391bae7775b2f039171" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34761 } } peers { permanent_uuid: "480d1bb62f8b4268879f84351e5f8788" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36725 } }
I20260619 06:43:21.658977 31208 heartbeater.cc:503] Master 127.10.192.126:45061 was elected leader, sending a full tablet report...
I20260619 06:43:21.659559 31358 ts_tablet_manager.cc:1428] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788: Time spent starting tablet: real 0.011s user 0.011s sys 0.000s
I20260619 06:43:21.660897 31338 heartbeater.cc:503] Master 127.10.192.126:45061 was elected leader, sending a full tablet report...
I20260619 06:43:21.661188 31356 ts_tablet_manager.cc:1428] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171: Time spent starting tablet: real 0.016s user 0.013s sys 0.003s
I20260619 06:43:21.662528 31357 ts_tablet_manager.cc:1428] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a: Time spent starting tablet: real 0.017s user 0.011s sys 0.003s
I20260619 06:43:21.780699 31362 raft_consensus.cc:482] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260619 06:43:21.781090 31362 raft_consensus.cc:504] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223ff6276ef143e59a9a362846da101a" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37631 } } peers { permanent_uuid: "2ff62f6f41f14391bae7775b2f039171" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34761 } } peers { permanent_uuid: "480d1bb62f8b4268879f84351e5f8788" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36725 } }
I20260619 06:43:21.782876 31362 leader_election.cc:288] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 223ff6276ef143e59a9a362846da101a (127.10.192.67:37631), 2ff62f6f41f14391bae7775b2f039171 (127.10.192.65:34761)
W20260619 06:43:21.791177 31339 tablet.cc:2369] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:43:21.792152 31353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:21.783727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:34373 (local address 127.10.192.65:34761)
0619 06:43:21.783959 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:21.783968 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:21.784481 (+ 513us) server_negotiation.cc:407] Connection header received
0619 06:43:21.784676 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:21.784682 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:21.784761 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:21.784865 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:21.785523 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.786663 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.789798 (+ 3135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.791080 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.791255 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:21.791320 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:21.791756 (+ 436us) server_negotiation.cc:299] Negotiation successful
0619 06:43:21.791910 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260619 06:43:21.792227 31351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:21.783375 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.10.192.66:36723 (local address 127.10.192.67:37631)
0619 06:43:21.783702 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:21.783711 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:21.784425 (+ 714us) server_negotiation.cc:407] Connection header received
0619 06:43:21.784712 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:21.784717 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:21.784787 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:21.784838 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0619 06:43:21.785618 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.786691 (+ 1073us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.789793 (+ 3102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.791073 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.791249 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:21.791320 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:21.791871 (+ 551us) server_negotiation.cc:299] Negotiation successful
0619 06:43:21.792011 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119}
I20260619 06:43:21.792245 31365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:21.783284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.65:34761 (local address 127.10.192.66:34373)
0619 06:43:21.784358 (+ 1074us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:21.784373 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:21.784541 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:21.784882 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:21.784886 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:21.784909 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:21.785352 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:21.785366 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.786826 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.786831 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:21.789529 (+ 2698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:21.789546 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.791293 (+ 1747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.791300 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:21.791522 (+ 222us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:21.791568 (+ 46us) client_negotiation.cc:769] Sending connection context
0619 06:43:21.791731 (+ 163us) client_negotiation.cc:240] Negotiation successful
0619 06:43:21.791870 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":974,"mutex_wait_us":119,"thread_start_us":638,"threads_started":1}
I20260619 06:43:21.792886 31366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:21.783202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.67:37631 (local address 127.10.192.66:36723)
0619 06:43:21.784298 (+ 1096us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:21.784315 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:21.784504 (+ 189us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:21.785004 (+ 500us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:21.785010 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:21.785038 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0619 06:43:21.785475 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:21.785484 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.786829 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.786833 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:21.789530 (+ 2697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:21.789546 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.791469 (+ 1923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.791477 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:21.791673 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:21.791718 (+ 45us) client_negotiation.cc:769] Sending connection context
0619 06:43:21.792430 (+ 712us) client_negotiation.cc:240] Negotiation successful
0619 06:43:21.792557 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":955,"mutex_wait_us":193,"thread_start_us":769,"threads_started":1}
I20260619 06:43:21.793459 31032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "221cf7abebd74eab8613ec6ee94bd8ff" candidate_uuid: "480d1bb62f8b4268879f84351e5f8788" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ff62f6f41f14391bae7775b2f039171" is_pre_election: true
I20260619 06:43:21.793880 31293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "221cf7abebd74eab8613ec6ee94bd8ff" candidate_uuid: "480d1bb62f8b4268879f84351e5f8788" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "223ff6276ef143e59a9a362846da101a" is_pre_election: true
I20260619 06:43:21.794070 31032 raft_consensus.cc:2454] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 480d1bb62f8b4268879f84351e5f8788 in term 0.
I20260619 06:43:21.794431 31293 raft_consensus.cc:2454] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 480d1bb62f8b4268879f84351e5f8788 in term 0.
I20260619 06:43:21.794749 31096 leader_election.cc:302] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ff62f6f41f14391bae7775b2f039171, 480d1bb62f8b4268879f84351e5f8788; no voters:
W20260619 06:43:21.795065 31209 tablet.cc:2369] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:43:21.795174 31362 raft_consensus.cc:2781] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260619 06:43:21.795327 31362 raft_consensus.cc:482] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260619 06:43:21.795460 31362 raft_consensus.cc:3037] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:21.797693 31362 raft_consensus.cc:504] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223ff6276ef143e59a9a362846da101a" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37631 } } peers { permanent_uuid: "2ff62f6f41f14391bae7775b2f039171" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34761 } } peers { permanent_uuid: "480d1bb62f8b4268879f84351e5f8788" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36725 } }
I20260619 06:43:21.798369 31362 leader_election.cc:288] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [CANDIDATE]: Term 1 election: Requested vote from peers 223ff6276ef143e59a9a362846da101a (127.10.192.67:37631), 2ff62f6f41f14391bae7775b2f039171 (127.10.192.65:34761)
I20260619 06:43:21.798797 31293 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "221cf7abebd74eab8613ec6ee94bd8ff" candidate_uuid: "480d1bb62f8b4268879f84351e5f8788" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "223ff6276ef143e59a9a362846da101a"
I20260619 06:43:21.798856 31032 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "221cf7abebd74eab8613ec6ee94bd8ff" candidate_uuid: "480d1bb62f8b4268879f84351e5f8788" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ff62f6f41f14391bae7775b2f039171"
I20260619 06:43:21.799034 31293 raft_consensus.cc:3037] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:21.799074 31032 raft_consensus.cc:3037] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:21.801294 31293 raft_consensus.cc:2454] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 480d1bb62f8b4268879f84351e5f8788 in term 1.
I20260619 06:43:21.801301 31032 raft_consensus.cc:2454] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 480d1bb62f8b4268879f84351e5f8788 in term 1.
I20260619 06:43:21.801759 31099 leader_election.cc:302] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 223ff6276ef143e59a9a362846da101a, 480d1bb62f8b4268879f84351e5f8788; no voters:
I20260619 06:43:21.802102 31362 raft_consensus.cc:2781] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:21.802568 31362 raft_consensus.cc:686] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [term 1 LEADER]: Becoming Leader. State: Replica: 480d1bb62f8b4268879f84351e5f8788, State: Running, Role: LEADER
I20260619 06:43:21.803058 31362 consensus_queue.cc:237] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223ff6276ef143e59a9a362846da101a" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37631 } } peers { permanent_uuid: "2ff62f6f41f14391bae7775b2f039171" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34761 } } peers { permanent_uuid: "480d1bb62f8b4268879f84351e5f8788" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36725 } }
W20260619 06:43:21.806025 31078 tablet.cc:2369] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:43:21.808046 30891 catalog_manager.cc:5495] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 reported cstate change: term changed from 0 to 1, leader changed from <none> to 480d1bb62f8b4268879f84351e5f8788 (127.10.192.66). New cstate: current_term: 1 leader_uuid: "480d1bb62f8b4268879f84351e5f8788" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "223ff6276ef143e59a9a362846da101a" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37631 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ff62f6f41f14391bae7775b2f039171" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34761 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "480d1bb62f8b4268879f84351e5f8788" member_type: VOTER last_known_addr { host: "127.10.192.66" port: 36725 } health_report { overall_health: HEALTHY } } }
I20260619 06:43:21.854684 31355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:21.848809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36616 (local address 127.10.192.66:36725)
0619 06:43:21.849048 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:21.849054 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:21.849155 (+ 101us) server_negotiation.cc:407] Connection header received
0619 06:43:21.849413 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:21.849418 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:21.849519 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:21.849687 (+ 168us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:43:21.850048 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.850876 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.852471 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.852891 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.853029 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:21.853510 (+ 481us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:43:21.854081 (+ 571us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:43:21.854268 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:21.854320 (+ 52us) server_negotiation.cc:299] Negotiation successful
0619 06:43:21.854403 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260619 06:43:21.863534 31032 raft_consensus.cc:1261] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171 [term 1 FOLLOWER]: Refusing update from remote peer 480d1bb62f8b4268879f84351e5f8788: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:43:21.863533 31293 raft_consensus.cc:1261] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a [term 1 FOLLOWER]: Refusing update from remote peer 480d1bb62f8b4268879f84351e5f8788: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:43:21.864832 31367 consensus_queue.cc:1035] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ff62f6f41f14391bae7775b2f039171" member_type: VOTER last_known_addr { host: "127.10.192.65" port: 34761 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:43:21.865259 31362 consensus_queue.cc:1035] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [LEADER]: Connected to new peer: Peer: permanent_uuid: "223ff6276ef143e59a9a362846da101a" member_type: VOTER last_known_addr { host: "127.10.192.67" port: 37631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:43:21.879902 31371 mvcc.cc:205] Tried to move back new op lower bound from 7298463342021771264 to 7298463341789278208. Current Snapshot: MvccSnapshot[applied={T|T < 7298463342021771264}]
I20260619 06:43:21.894563 30890 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:43:21.894934 30890 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46834:
table { table_name: "test-table" } modify_external_catalogs: true
I20260619 06:43:21.899688 30890 catalog_manager.cc:5782] T 00000000000000000000000000000000 P fd739cd6c7864ffa9537a1af3b31dda5: Sending DeleteTablet for 3 replicas of tablet 221cf7abebd74eab8613ec6ee94bd8ff
I20260619 06:43:21.901182 31273 tablet_service.cc:1514] Processing DeleteTablet for tablet 221cf7abebd74eab8613ec6ee94bd8ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:43:21 UTC) from {username='slave'} at 127.0.0.1:33808
I20260619 06:43:21.901274 31143 tablet_service.cc:1514] Processing DeleteTablet for tablet 221cf7abebd74eab8613ec6ee94bd8ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:43:21 UTC) from {username='slave'} at 127.0.0.1:36606
I20260619 06:43:21.901260 31012 tablet_service.cc:1514] Processing DeleteTablet for tablet 221cf7abebd74eab8613ec6ee94bd8ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-06-19 06:43:21 UTC) from {username='slave'} at 127.0.0.1:54316
I20260619 06:43:21.903658 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 30950
I20260619 06:43:21.911353 31382 tablet_replica.cc:330] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a: stopping tablet replica
I20260619 06:43:21.912070 31382 raft_consensus.cc:2229] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:43:21.912830 31382 raft_consensus.cc:2258] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:43:21.913836 31380 tablet_replica.cc:330] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171: stopping tablet replica
I20260619 06:43:21.914523 31381 tablet_replica.cc:330] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788: stopping tablet replica
I20260619 06:43:21.915643 31381 raft_consensus.cc:2229] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [term 1 LEADER]: Raft consensus shutting down.
I20260619 06:43:21.916013 31382 ts_tablet_manager.cc:1905] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:43:21.915431 31380 raft_consensus.cc:2229] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260619 06:43:21.916682 31380 raft_consensus.cc:2258] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:43:21.917467 31381 raft_consensus.cc:2258] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260619 06:43:21.919997 31380 ts_tablet_manager.cc:1905] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:43:21.922981 31382 ts_tablet_manager.cc:1918] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:43:21.923189 31382 log.cc:1196] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-2/wal/wals/221cf7abebd74eab8613ec6ee94bd8ff
I20260619 06:43:21.926600 31381 ts_tablet_manager.cc:1905] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260619 06:43:21.927297 31382 ts_tablet_manager.cc:1939] T 221cf7abebd74eab8613ec6ee94bd8ff P 223ff6276ef143e59a9a362846da101a: Deleting consensus metadata
I20260619 06:43:21.928876 31380 ts_tablet_manager.cc:1918] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:43:21.929083 31380 log.cc:1196] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-0/wal/wals/221cf7abebd74eab8613ec6ee94bd8ff
I20260619 06:43:21.929423 30878 catalog_manager.cc:4841] TS 223ff6276ef143e59a9a362846da101a (127.10.192.67:37631): tablet 221cf7abebd74eab8613ec6ee94bd8ff (table test-table [id=da3db878309a48299845faa14c2e17e7]) successfully deleted
I20260619 06:43:21.929737 31380 ts_tablet_manager.cc:1939] T 221cf7abebd74eab8613ec6ee94bd8ff P 2ff62f6f41f14391bae7775b2f039171: Deleting consensus metadata
I20260619 06:43:21.930683 31353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:21.905435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54320 (local address 127.10.192.65:34761)
0619 06:43:21.905689 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:21.905699 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:21.914138 (+ 8439us) server_negotiation.cc:407] Connection header received
0619 06:43:21.914461 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:21.914467 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:21.914601 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:21.914694 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:21.915435 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.917366 (+ 1931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.919421 (+ 2055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:21.920175 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:21.920292 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:21.928731 (+ 8439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:21.928747 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:21.928765 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:21.929694 (+ 929us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:21.929782 (+ 88us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:21.929827 (+ 45us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:21.929938 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:21.930155 (+ 217us) server_negotiation.cc:299] Negotiation successful
0619 06:43:21.930305 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260619 06:43:21.931836 30875 catalog_manager.cc:4841] TS 2ff62f6f41f14391bae7775b2f039171 (127.10.192.65:34761): tablet 221cf7abebd74eab8613ec6ee94bd8ff (table test-table [id=da3db878309a48299845faa14c2e17e7]) successfully deleted
I20260619 06:43:21.932169 31072 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:21.937129 31381 ts_tablet_manager.cc:1918] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260619 06:43:21.937345 31381 log.cc:1196] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788: Deleting WAL directory at /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1781851080573990-11009-0/minicluster-data/ts-1/wal/wals/221cf7abebd74eab8613ec6ee94bd8ff
I20260619 06:43:21.937880 31381 ts_tablet_manager.cc:1939] T 221cf7abebd74eab8613ec6ee94bd8ff P 480d1bb62f8b4268879f84351e5f8788: Deleting consensus metadata
I20260619 06:43:21.939500 30875 catalog_manager.cc:4841] TS 480d1bb62f8b4268879f84351e5f8788 (127.10.192.66:36725): tablet 221cf7abebd74eab8613ec6ee94bd8ff (table test-table [id=da3db878309a48299845faa14c2e17e7]) successfully deleted
I20260619 06:43:22.056728 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 30950
I20260619 06:43:22.075337 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 31081
I20260619 06:43:22.083877 31355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:22.076302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36618 (local address 127.10.192.66:36725)
0619 06:43:22.076513 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:22.076519 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:22.076543 (+ 24us) server_negotiation.cc:407] Connection header received
0619 06:43:22.076669 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:22.076675 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:22.076777 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:22.076898 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:22.077258 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:22.078540 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:22.079952 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:22.080648 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:22.080795 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:22.081997 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:22.082009 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:22.082028 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:22.082945 (+ 917us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:22.083011 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:22.083037 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:22.083147 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:22.083292 (+ 145us) server_negotiation.cc:299] Negotiation successful
0619 06:43:22.083414 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260619 06:43:22.084764 31203 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:22.198107 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 31081
I20260619 06:43:22.216578 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 31211
I20260619 06:43:22.224035 31351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:22.217393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33824 (local address 127.10.192.67:37631)
0619 06:43:22.217614 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:22.217621 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:22.217717 (+ 96us) server_negotiation.cc:407] Connection header received
0619 06:43:22.217947 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:22.217951 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:22.218046 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:22.218156 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:22.218572 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:22.219504 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:22.220793 (+ 1289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:22.221206 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:22.221351 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:22.222511 (+ 1160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:22.222519 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:22.222534 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:22.223101 (+ 567us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:22.223155 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:22.223176 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:22.223301 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:22.223438 (+ 137us) server_negotiation.cc:299] Negotiation successful
0619 06:43:22.223551 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260619 06:43:22.224710 31333 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:22.314878 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 31211
I20260619 06:43:22.331601 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 30860
I20260619 06:43:22.332748 30921 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:22.444705 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 30860
2026-06-19T06:43:22Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3004 ms)
[----------] 6 tests from EncryptionPolicyTest (22079 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:22 dist-test-slave-7lz4 krb5kdc[31390](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:22 dist-test-slave-7lz4 krb5kdc[31390](info): set up 2 sockets
Jun 19 06:43:22 dist-test-slave-7lz4 krb5kdc[31390](info): commencing operation
krb5kdc: starting...
W20260619 06:43:23.580230 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.004s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:23 dist-test-slave-7lz4 krb5kdc[31390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 06:43:23.845465 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40763
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35893
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40763
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:24.194185 31403 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:24.194525 31403 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:24.194626 31403 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:24.202214 31403 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:24.202349 31403 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:24.202404 31403 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:24.202477 31403 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:24.202525 31403 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:24.212865 31403 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35893
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40763
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40763
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:24.214251 31403 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:24.215618 31403 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:24.228643 31409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:24.228760 31408 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:24.228780 31411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:24.229764 31403 server_base.cc:1034] running on GCE node
I20260619 06:43:24.230611 31403 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:24.232265 31403 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:24.233497 31403 hybrid_clock.cc:648] HybridClock initialized: now 1781851404233448 us; error 40 us; skew 500 ppm
I20260619 06:43:24.233901 31403 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:24 dist-test-slave-7lz4 krb5kdc[31390](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851404, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:24.237344 31403 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 06:43:24.238924 31403 webserver.cc:460] Webserver started at http://127.0.0.1:42487/ using document root <none> and password file <none>
I20260619 06:43:24.239764 31403 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:24.239888 31403 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:24.240154 31403 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:24.243263 31403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "1e547ad152dc4f8c8e736fefcb0b2679"
format_stamp: "Formatted at 2026-06-19 06:43:24 on dist-test-slave-7lz4"
server_key: "d8d98a3a46d4afb69e11891fc4079e82"
server_key_iv: "4ef0524210564789e68c01d3572ca6e0"
server_key_version: "encryptionkey@0"
I20260619 06:43:24.244156 31403 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "1e547ad152dc4f8c8e736fefcb0b2679"
format_stamp: "Formatted at 2026-06-19 06:43:24 on dist-test-slave-7lz4"
server_key: "d8d98a3a46d4afb69e11891fc4079e82"
server_key_iv: "4ef0524210564789e68c01d3572ca6e0"
server_key_version: "encryptionkey@0"
I20260619 06:43:24.249547 31403 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 06:43:24.253252 31418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:24.254720 31403 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 06:43:24.254962 31403 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "1e547ad152dc4f8c8e736fefcb0b2679"
format_stamp: "Formatted at 2026-06-19 06:43:24 on dist-test-slave-7lz4"
server_key: "d8d98a3a46d4afb69e11891fc4079e82"
server_key_iv: "4ef0524210564789e68c01d3572ca6e0"
server_key_version: "encryptionkey@0"
I20260619 06:43:24.255148 31403 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:24.286854 31403 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:24.292335 31403 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:24.292609 31403 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:24.312029 31403 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40763
I20260619 06:43:24.312064 31469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40763 every 8 connection(s)
I20260619 06:43:24.313529 31403 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:24.317692 31470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:24.321306 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 31403
I20260619 06:43:24.321532 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:24.322162 11009 external_mini_cluster.cc:1428] Setting key f2f3a0106cfe859cb43ba335ee2db4a8
I20260619 06:43:24.331655 31470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679: Bootstrap starting.
I20260619 06:43:24.335438 31470 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:24.336531 31470 log.cc:824] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679: Log is configured to *not* fsync() on all Append() calls
Jun 19 06:43:24 dist-test-slave-7lz4 krb5kdc[31390](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851403, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260619 06:43:24.339838 31470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679: No bootstrap required, opened a new log
I20260619 06:43:24.346976 31473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:24.324327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37387 (local address 127.0.0.1:40763)
0619 06:43:24.325169 (+ 842us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:24.325185 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:24.325238 (+ 53us) server_negotiation.cc:407] Connection header received
0619 06:43:24.327192 (+ 1954us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:24.327230 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:24.327866 (+ 636us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:24.328345 (+ 479us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:24.329727 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:24.331775 (+ 2048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:24.333043 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:24.334208 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:24.334408 (+ 200us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:24.338915 (+ 4507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:24.338923 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:24.338938 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:24.338979 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:24.342263 (+ 3284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:24.343277 (+ 1014us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:24.343284 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:24.343294 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:24.343478 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:24.344078 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:24.344081 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:24.344083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:24.344658 (+ 575us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:24.344937 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:24.345462 (+ 525us) server_negotiation.cc:299] Negotiation successful
0619 06:43:24.345838 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":387,"threads_started":1}
I20260619 06:43:24.348937 31470 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e547ad152dc4f8c8e736fefcb0b2679" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40763 } }
I20260619 06:43:24.349341 31470 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:24.349494 31470 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e547ad152dc4f8c8e736fefcb0b2679, State: Initialized, Role: FOLLOWER
I20260619 06:43:24.350095 31470 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e547ad152dc4f8c8e736fefcb0b2679" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40763 } }
I20260619 06:43:24.350391 31470 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:24.350548 31470 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:24.350728 31470 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:24.351346 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:43:24.353185 31470 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e547ad152dc4f8c8e736fefcb0b2679" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40763 } }
I20260619 06:43:24.353727 31470 leader_election.cc:302] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1e547ad152dc4f8c8e736fefcb0b2679; no voters:
I20260619 06:43:24.354405 31470 leader_election.cc:288] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:24.354517 31476 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:24.359596 31476 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679 [term 1 LEADER]: Becoming Leader. State: Replica: 1e547ad152dc4f8c8e736fefcb0b2679, State: Running, Role: LEADER
I20260619 06:43:24.360946 31476 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e547ad152dc4f8c8e736fefcb0b2679" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40763 } }
I20260619 06:43:24.364951 31478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1e547ad152dc4f8c8e736fefcb0b2679" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e547ad152dc4f8c8e736fefcb0b2679" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40763 } } }
I20260619 06:43:24.366581 31478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:24.366307 31470 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:24.366616 31479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1e547ad152dc4f8c8e736fefcb0b2679. Latest consensus state: current_term: 1 leader_uuid: "1e547ad152dc4f8c8e736fefcb0b2679" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1e547ad152dc4f8c8e736fefcb0b2679" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40763 } } }
I20260619 06:43:24.370618 31479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:24.378631 31483 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:24.391867 31483 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:24.397974 31473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:24.370561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59503 (local address 127.0.0.1:40763)
0619 06:43:24.370739 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:24.370746 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:24.370772 (+ 26us) server_negotiation.cc:407] Connection header received
0619 06:43:24.371603 (+ 831us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:24.371608 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:24.371751 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:24.371870 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:24.374160 (+ 2290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:24.375854 (+ 1694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:24.378252 (+ 2398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:24.378881 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:24.378964 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:24.387107 (+ 8143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:24.387122 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:24.387128 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:24.387226 (+ 98us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:24.392658 (+ 5432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:24.394018 (+ 1360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:24.394025 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:24.394030 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:24.394203 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:24.394965 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:24.394973 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:24.394980 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:24.395440 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:24.395781 (+ 341us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:24.397136 (+ 1355us) server_negotiation.cc:299] Negotiation successful
0619 06:43:24.397389 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 06:43:24.419035 31483 catalog_manager.cc:1347] Generated new cluster ID: d5b6cac4e5b64b6bb37e5175a613a1d6
I20260619 06:43:24.419203 31483 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:24.441437 31483 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:24.442816 31483 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:24.456274 31483 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1e547ad152dc4f8c8e736fefcb0b2679: Generated new TSK 0
I20260619 06:43:24.457316 31483 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:24.471256 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 31403
I20260619 06:43:24.473385 31465 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:24.572018 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 31403
W20260619 06:43:24.591414 31388 connection.cc:535] client connection to 127.0.0.1:40763 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40763): Connection reset by peer (error 104)
2026-06-19T06:43:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2124 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:24 dist-test-slave-7lz4 krb5kdc[31502](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:24 dist-test-slave-7lz4 krb5kdc[31502](info): set up 2 sockets
Jun 19 06:43:24 dist-test-slave-7lz4 krb5kdc[31502](info): commencing operation
krb5kdc: starting...
W20260619 06:43:25.680074 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.069s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:25 dist-test-slave-7lz4 krb5kdc[31502](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851405, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 06:43:25.945143 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33281
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45707
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33281
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:26.291033 31515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:26.291394 31515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:26.291570 31515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:26.299749 31515 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:26.299914 31515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:26.300004 31515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:26.300108 31515 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:26.300189 31515 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:26.310696 31515 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45707
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33281
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:26.312260 31515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:26.313629 31515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:26.326045 31520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:26.326115 31521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:26.325999 31523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:26.326813 31515 server_base.cc:1034] running on GCE node
I20260619 06:43:26.327677 31515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:26.329195 31515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:26.330410 31515 hybrid_clock.cc:648] HybridClock initialized: now 1781851406330352 us; error 55 us; skew 500 ppm
I20260619 06:43:26.330781 31515 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:26 dist-test-slave-7lz4 krb5kdc[31502](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851406, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:26.334134 31515 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 06:43:26.335829 31515 webserver.cc:460] Webserver started at http://127.0.0.1:44915/ using document root <none> and password file <none>
I20260619 06:43:26.336555 31515 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:26.336691 31515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:26.337018 31515 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:26.340173 31515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "4a697d7b6dc94392951cd40ea71a50c3"
format_stamp: "Formatted at 2026-06-19 06:43:26 on dist-test-slave-7lz4"
server_key: "d82902a1e206960a7a31d5da8b5d8d64"
server_key_iv: "aad94aeca046c3db43c9b4e17f71e2e5"
server_key_version: "encryptionkey@0"
I20260619 06:43:26.340960 31515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "4a697d7b6dc94392951cd40ea71a50c3"
format_stamp: "Formatted at 2026-06-19 06:43:26 on dist-test-slave-7lz4"
server_key: "d82902a1e206960a7a31d5da8b5d8d64"
server_key_iv: "aad94aeca046c3db43c9b4e17f71e2e5"
server_key_version: "encryptionkey@0"
I20260619 06:43:26.346480 31515 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260619 06:43:26.350126 31530 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:26.351609 31515 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260619 06:43:26.351922 31515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "4a697d7b6dc94392951cd40ea71a50c3"
format_stamp: "Formatted at 2026-06-19 06:43:26 on dist-test-slave-7lz4"
server_key: "d82902a1e206960a7a31d5da8b5d8d64"
server_key_iv: "aad94aeca046c3db43c9b4e17f71e2e5"
server_key_version: "encryptionkey@0"
I20260619 06:43:26.352120 31515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:26.371378 31515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:26.375623 31515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:26.376008 31515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:26.395116 31515 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33281
I20260619 06:43:26.395146 31581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33281 every 8 connection(s)
I20260619 06:43:26.396576 31515 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:26.400481 31582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:26.401718 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 31515
I20260619 06:43:26.401932 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:26.402395 11009 external_mini_cluster.cc:1428] Setting key f203288bc82cbc20501bfff0a177a74e
I20260619 06:43:26.416043 31582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3: Bootstrap starting.
I20260619 06:43:26.418063 31585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:26.404383 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56203 (local address 127.0.0.1:33281)
0619 06:43:26.405206 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:26.405222 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:26.405279 (+ 57us) server_negotiation.cc:407] Connection header received
0619 06:43:26.407303 (+ 2024us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:26.407338 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:26.407994 (+ 656us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:26.408501 (+ 507us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:26.409104 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:26.410993 (+ 1889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:26.412530 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:26.413666 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:26.413840 (+ 174us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:26.415094 (+ 1254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:26.415105 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:26.415126 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:26.415903 (+ 777us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:26.416004 (+ 101us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:26.416044 (+ 40us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:26.416211 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:26.416506 (+ 295us) server_negotiation.cc:299] Negotiation successful
0619 06:43:26.416688 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":570,"thread_start_us":334,"threads_started":1}
I20260619 06:43:26.419907 31582 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:26.421113 31582 log.cc:824] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:26.422283 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:43:26.424124 31582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3: No bootstrap required, opened a new log
I20260619 06:43:26.432467 31582 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a697d7b6dc94392951cd40ea71a50c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33281 } }
I20260619 06:43:26.432924 31582 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:26.433089 31582 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a697d7b6dc94392951cd40ea71a50c3, State: Initialized, Role: FOLLOWER
I20260619 06:43:26.433322 31585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:26.426798 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33273 (local address 127.0.0.1:33281)
0619 06:43:26.426995 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:26.427004 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:26.427389 (+ 385us) server_negotiation.cc:407] Connection header received
0619 06:43:26.427614 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:26.427618 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:26.427740 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:26.427854 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:26.428374 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:26.429230 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:26.430554 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:26.431025 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:26.431191 (+ 166us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:26.432495 (+ 1304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:26.432500 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:26.432503 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:26.432521 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:26.432560 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:26.432576 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:26.432698 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:26.432895 (+ 197us) server_negotiation.cc:299] Negotiation successful
0619 06:43:26.432956 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260619 06:43:26.433862 31582 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a697d7b6dc94392951cd40ea71a50c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33281 } }
I20260619 06:43:26.434155 31582 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:26.434319 31582 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:26.434518 31582 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:26.437228 31582 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a697d7b6dc94392951cd40ea71a50c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33281 } }
I20260619 06:43:26.437789 31582 leader_election.cc:302] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4a697d7b6dc94392951cd40ea71a50c3; no voters:
I20260619 06:43:26.438401 31582 leader_election.cc:288] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:26.438544 31592 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:26.439272 31592 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3 [term 1 LEADER]: Becoming Leader. State: Replica: 4a697d7b6dc94392951cd40ea71a50c3, State: Running, Role: LEADER
I20260619 06:43:26.439957 31592 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a697d7b6dc94392951cd40ea71a50c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33281 } }
I20260619 06:43:26.440675 31582 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:26.442992 31594 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a697d7b6dc94392951cd40ea71a50c3. Latest consensus state: current_term: 1 leader_uuid: "4a697d7b6dc94392951cd40ea71a50c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a697d7b6dc94392951cd40ea71a50c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33281 } } }
I20260619 06:43:26.443502 31593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4a697d7b6dc94392951cd40ea71a50c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4a697d7b6dc94392951cd40ea71a50c3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33281 } } }
I20260619 06:43:26.444103 31593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:26.444108 31594 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:26.444876 31601 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:26.453450 31601 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:26.463726 31601 catalog_manager.cc:1347] Generated new cluster ID: ffe9ef5335e4499481a8f15f02150a60
I20260619 06:43:26.463948 31601 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:26.471168 31601 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:26.472582 31601 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:26.485595 31601 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4a697d7b6dc94392951cd40ea71a50c3: Generated new TSK 0
I20260619 06:43:26.486569 31601 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:26.493332 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 31515
W20260619 06:43:26.495149 31577 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:56203
W20260619 06:43:26.495983 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 31515: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:43:26.496181 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 31515
W20260619 06:43:26.513332 31500 connection.cc:535] client connection to 127.0.0.1:33281 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33281): Connection reset by peer (error 104)
2026-06-19T06:43:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1921 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:26 dist-test-slave-7lz4 krb5kdc[31613](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:26 dist-test-slave-7lz4 krb5kdc[31613](info): set up 2 sockets
Jun 19 06:43:26 dist-test-slave-7lz4 krb5kdc[31613](info): commencing operation
krb5kdc: starting...
W20260619 06:43:27.608178 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.003s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:27 dist-test-slave-7lz4 krb5kdc[31613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 06:43:27.874955 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41757
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41757
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:28.217367 31626 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:28.217705 31626 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:28.217896 31626 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:28.225418 31626 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:28.225548 31626 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:28.225636 31626 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:28.225741 31626 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:28.225840 31626 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:28.236255 31626 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41757
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41757
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:28.237663 31626 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:28.239007 31626 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:28.251214 31631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:28.251152 31632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:28.251125 31634 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:28.252256 31626 server_base.cc:1034] running on GCE node
I20260619 06:43:28.253150 31626 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:28.254729 31626 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:28.255985 31626 hybrid_clock.cc:648] HybridClock initialized: now 1781851408255939 us; error 48 us; skew 500 ppm
I20260619 06:43:28.256368 31626 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:28 dist-test-slave-7lz4 krb5kdc[31613](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851408, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:28.263439 31626 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 06:43:28.265199 31626 webserver.cc:460] Webserver started at http://127.0.0.1:45607/ using document root <none> and password file <none>
I20260619 06:43:28.265954 31626 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:28.266110 31626 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:28.266438 31626 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:28.269783 31626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "038b1618bbb3466ea031f6c52a2a7931"
format_stamp: "Formatted at 2026-06-19 06:43:28 on dist-test-slave-7lz4"
server_key: "15f1a5f5bb45cd71c9a5e4fc863c75cf"
server_key_iv: "4b8f417e53eabab929af559c24541db6"
server_key_version: "encryptionkey@0"
I20260619 06:43:28.270635 31626 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "038b1618bbb3466ea031f6c52a2a7931"
format_stamp: "Formatted at 2026-06-19 06:43:28 on dist-test-slave-7lz4"
server_key: "15f1a5f5bb45cd71c9a5e4fc863c75cf"
server_key_iv: "4b8f417e53eabab929af559c24541db6"
server_key_version: "encryptionkey@0"
I20260619 06:43:28.276157 31626 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 06:43:28.279857 31641 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:28.281450 31626 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:43:28.281659 31626 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "038b1618bbb3466ea031f6c52a2a7931"
format_stamp: "Formatted at 2026-06-19 06:43:28 on dist-test-slave-7lz4"
server_key: "15f1a5f5bb45cd71c9a5e4fc863c75cf"
server_key_iv: "4b8f417e53eabab929af559c24541db6"
server_key_version: "encryptionkey@0"
I20260619 06:43:28.281890 31626 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:28.288051 31626 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:28.292482 31626 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:28.292796 31626 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:28.311985 31626 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41757
I20260619 06:43:28.312079 31692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41757 every 8 connection(s)
I20260619 06:43:28.313514 31626 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:28.317696 31693 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:28.321110 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 31626
I20260619 06:43:28.321316 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:28.321911 11009 external_mini_cluster.cc:1428] Setting key 3fdb8fdf916fe75be38fced6ac165fe5
I20260619 06:43:28.330349 31696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:28.324010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56275 (local address 127.0.0.1:41757)
0619 06:43:28.324852 (+ 842us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:28.324865 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:28.324906 (+ 41us) server_negotiation.cc:407] Connection header received
0619 06:43:28.326590 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:28.326616 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:28.326986 (+ 370us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:28.327517 (+ 531us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:28.328656 (+ 1139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:28.328666 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:28.328680 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:28.328694 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:28.328751 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:28.328770 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:28.329044 (+ 274us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:28.329193 (+ 149us) server_negotiation.cc:299] Negotiation successful
0619 06:43:28.329390 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":385,"threads_started":1}
I20260619 06:43:28.331418 31693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931: Bootstrap starting.
I20260619 06:43:28.334125 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:43:28.335132 31693 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:28.336386 31693 log.cc:824] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:28.340432 31693 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931: No bootstrap required, opened a new log
I20260619 06:43:28.341470 31696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:28.338992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38609 (local address 127.0.0.1:41757)
0619 06:43:28.339183 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:28.339188 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:28.339378 (+ 190us) server_negotiation.cc:407] Connection header received
0619 06:43:28.339576 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:28.339579 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:28.339626 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:28.339757 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:28.340781 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:28.340785 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:28.340788 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:28.340803 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:28.340843 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:28.340858 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:28.340952 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:28.341118 (+ 166us) server_negotiation.cc:299] Negotiation successful
0619 06:43:28.341165 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 06:43:28.348866 31693 raft_consensus.cc:348] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "038b1618bbb3466ea031f6c52a2a7931" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41757 } }
I20260619 06:43:28.349417 31693 raft_consensus.cc:374] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:28.349558 31693 raft_consensus.cc:729] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 038b1618bbb3466ea031f6c52a2a7931, State: Initialized, Role: FOLLOWER
I20260619 06:43:28.350191 31693 consensus_queue.cc:260] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "038b1618bbb3466ea031f6c52a2a7931" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41757 } }
I20260619 06:43:28.350499 31693 raft_consensus.cc:388] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:28.350690 31693 raft_consensus.cc:482] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:28.350893 31693 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:28.353430 31693 raft_consensus.cc:504] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "038b1618bbb3466ea031f6c52a2a7931" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41757 } }
I20260619 06:43:28.354039 31693 leader_election.cc:302] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 038b1618bbb3466ea031f6c52a2a7931; no voters:
I20260619 06:43:28.354674 31693 leader_election.cc:288] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:28.354839 31703 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:28.355546 31703 raft_consensus.cc:686] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931 [term 1 LEADER]: Becoming Leader. State: Replica: 038b1618bbb3466ea031f6c52a2a7931, State: Running, Role: LEADER
I20260619 06:43:28.356105 31703 consensus_queue.cc:237] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "038b1618bbb3466ea031f6c52a2a7931" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41757 } }
I20260619 06:43:28.357136 31693 sys_catalog.cc:564] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:28.359234 31705 sys_catalog.cc:455] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 038b1618bbb3466ea031f6c52a2a7931. Latest consensus state: current_term: 1 leader_uuid: "038b1618bbb3466ea031f6c52a2a7931" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "038b1618bbb3466ea031f6c52a2a7931" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41757 } } }
I20260619 06:43:28.359359 31704 sys_catalog.cc:455] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "038b1618bbb3466ea031f6c52a2a7931" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "038b1618bbb3466ea031f6c52a2a7931" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41757 } } }
I20260619 06:43:28.359874 31705 sys_catalog.cc:458] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:28.360141 31704 sys_catalog.cc:458] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:28.364704 31708 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:28.370544 31708 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:28.380236 31708 catalog_manager.cc:1347] Generated new cluster ID: 573a2b7ab6f04a8b8d5b260dae5ecefc
I20260619 06:43:28.380432 31708 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:28.412511 31708 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:28.413014 31708 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:28.424171 31708 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 038b1618bbb3466ea031f6c52a2a7931: Generated new TSK 0
I20260619 06:43:28.425079 31708 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:28.436148 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 31626
W20260619 06:43:28.438155 31688 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:56275
W20260619 06:43:28.438987 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 31626: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:43:28.439149 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 31626
2026-06-19T06:43:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1943 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:28 dist-test-slave-7lz4 krb5kdc[31724](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:28 dist-test-slave-7lz4 krb5kdc[31724](info): set up 2 sockets
Jun 19 06:43:28 dist-test-slave-7lz4 krb5kdc[31724](info): commencing operation
krb5kdc: starting...
W20260619 06:43:29.567909 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.000s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:29 dist-test-slave-7lz4 krb5kdc[31724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851409, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 06:43:29.826992 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46643
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46643
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:30.162402 31737 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:30.162701 31737 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:30.162878 31737 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:30.170176 31737 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:30.170351 31737 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:30.170503 31737 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:30.170608 31737 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:30.170674 31737 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:30.181533 31737 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46643
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46643
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:30.182857 31737 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:30.184235 31737 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:30.196331 31743 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:30.196374 31745 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:30.196568 31742 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:30.197320 31737 server_base.cc:1034] running on GCE node
I20260619 06:43:30.198168 31737 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:30.199707 31737 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:30.200943 31737 hybrid_clock.cc:648] HybridClock initialized: now 1781851410200899 us; error 41 us; skew 500 ppm
I20260619 06:43:30.201313 31737 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:30 dist-test-slave-7lz4 krb5kdc[31724](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851410, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:30.204442 31737 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 06:43:30.205945 31737 webserver.cc:460] Webserver started at http://127.0.0.1:41259/ using document root <none> and password file <none>
I20260619 06:43:30.206646 31737 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:30.206794 31737 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:30.207094 31737 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:30.210186 31737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "749e4bf45c5046179f41e30744ad947f"
format_stamp: "Formatted at 2026-06-19 06:43:30 on dist-test-slave-7lz4"
server_key: "0c09aee851c0ce9ceb3b18cec04ae2cf"
server_key_iv: "18cdbac0be041c59ff19187aa5adf22a"
server_key_version: "encryptionkey@0"
I20260619 06:43:30.211068 31737 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "749e4bf45c5046179f41e30744ad947f"
format_stamp: "Formatted at 2026-06-19 06:43:30 on dist-test-slave-7lz4"
server_key: "0c09aee851c0ce9ceb3b18cec04ae2cf"
server_key_iv: "18cdbac0be041c59ff19187aa5adf22a"
server_key_version: "encryptionkey@0"
I20260619 06:43:30.216889 31737 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260619 06:43:30.220486 31752 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:30.221884 31737 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:43:30.222082 31737 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "749e4bf45c5046179f41e30744ad947f"
format_stamp: "Formatted at 2026-06-19 06:43:30 on dist-test-slave-7lz4"
server_key: "0c09aee851c0ce9ceb3b18cec04ae2cf"
server_key_iv: "18cdbac0be041c59ff19187aa5adf22a"
server_key_version: "encryptionkey@0"
I20260619 06:43:30.222303 31737 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:30.243052 31737 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:30.247702 31737 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:30.248049 31737 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:30.267243 31737 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46643
I20260619 06:43:30.267272 31803 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46643 every 8 connection(s)
I20260619 06:43:30.268702 31737 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:30.272279 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 31737
I20260619 06:43:30.272471 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:30.272639 31804 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:30.273028 11009 external_mini_cluster.cc:1428] Setting key 262384c27beae4b6c11132e4ea60c8e5
I20260619 06:43:30.287956 31804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f: Bootstrap starting.
Jun 19 06:43:30 dist-test-slave-7lz4 krb5kdc[31724](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851409, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260619 06:43:30.292136 31804 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:30.293557 31804 log.cc:824] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:30.297129 31804 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f: No bootstrap required, opened a new log
I20260619 06:43:30.298244 31807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:30.274786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42137 (local address 127.0.0.1:46643)
0619 06:43:30.275620 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:30.275691 (+ 71us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:30.275749 (+ 58us) server_negotiation.cc:407] Connection header received
0619 06:43:30.277517 (+ 1768us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:30.277541 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:30.277981 (+ 440us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:30.278324 (+ 343us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:30.280181 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:30.281510 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:30.283453 (+ 1943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:30.284259 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:30.284422 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:30.289406 (+ 4984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:30.289421 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:30.289443 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:30.289508 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:30.293572 (+ 4064us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:30.294422 (+ 850us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:30.294429 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:30.294435 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:30.294603 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:30.295050 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:30.295055 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:30.295058 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:30.295757 (+ 699us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:30.296050 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:30.296401 (+ 351us) server_negotiation.cc:299] Negotiation successful
0619 06:43:30.296842 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":373,"threads_started":1}
I20260619 06:43:30.302119 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:43:30.305955 31804 raft_consensus.cc:348] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "749e4bf45c5046179f41e30744ad947f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46643 } }
I20260619 06:43:30.306454 31804 raft_consensus.cc:374] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:30.306627 31804 raft_consensus.cc:729] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 749e4bf45c5046179f41e30744ad947f, State: Initialized, Role: FOLLOWER
I20260619 06:43:30.307318 31804 consensus_queue.cc:260] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "749e4bf45c5046179f41e30744ad947f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46643 } }
I20260619 06:43:30.307701 31804 raft_consensus.cc:388] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:30.307861 31804 raft_consensus.cc:482] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:30.308055 31804 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:30.310984 31804 raft_consensus.cc:504] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "749e4bf45c5046179f41e30744ad947f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46643 } }
I20260619 06:43:30.311657 31804 leader_election.cc:302] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 749e4bf45c5046179f41e30744ad947f; no voters:
I20260619 06:43:30.312356 31804 leader_election.cc:288] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:30.312487 31814 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:30.313728 31814 raft_consensus.cc:686] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f [term 1 LEADER]: Becoming Leader. State: Replica: 749e4bf45c5046179f41e30744ad947f, State: Running, Role: LEADER
I20260619 06:43:30.314473 31814 consensus_queue.cc:237] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "749e4bf45c5046179f41e30744ad947f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46643 } }
I20260619 06:43:30.314770 31804 sys_catalog.cc:564] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:30.319502 31816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 749e4bf45c5046179f41e30744ad947f. Latest consensus state: current_term: 1 leader_uuid: "749e4bf45c5046179f41e30744ad947f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "749e4bf45c5046179f41e30744ad947f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46643 } } }
I20260619 06:43:30.319954 31816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:30.320457 31815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "749e4bf45c5046179f41e30744ad947f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "749e4bf45c5046179f41e30744ad947f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46643 } } }
I20260619 06:43:30.320825 31815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:30.326377 31807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:30.306338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50455 (local address 127.0.0.1:46643)
0619 06:43:30.306541 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:30.306549 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:30.307029 (+ 480us) server_negotiation.cc:407] Connection header received
0619 06:43:30.307211 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:30.307217 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:30.307306 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:30.307417 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:30.309039 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:30.310173 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:30.311501 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:30.312246 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:30.312413 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:30.315768 (+ 3355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:30.315777 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:30.315785 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:30.315835 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:30.321344 (+ 5509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:30.322318 (+ 974us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:30.322321 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:30.322324 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:30.322457 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:30.322992 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:30.323000 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:30.323006 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:30.323503 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:30.325346 (+ 1843us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:30.325526 (+ 180us) server_negotiation.cc:299] Negotiation successful
0619 06:43:30.325838 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260619 06:43:30.333303 31824 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:30.337728 31824 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:30.346741 31824 catalog_manager.cc:1347] Generated new cluster ID: 69ff7ee05bac4f9689fff1f2880a3ef4
I20260619 06:43:30.346895 31824 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:30.365269 31824 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:30.366753 31824 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:30.377247 31824 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 749e4bf45c5046179f41e30744ad947f: Generated new TSK 0
I20260619 06:43:30.378139 31824 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:30.391995 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 31737
I20260619 06:43:30.393203 31799 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:30.487430 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 31737
2026-06-19T06:43:30Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2048 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:30 dist-test-slave-7lz4 krb5kdc[31836](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:30 dist-test-slave-7lz4 krb5kdc[31836](info): set up 2 sockets
Jun 19 06:43:30 dist-test-slave-7lz4 krb5kdc[31836](info): commencing operation
krb5kdc: starting...
W20260619 06:43:31.600135 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.002s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:31 dist-test-slave-7lz4 krb5kdc[31836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851411, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 06:43:31.865206 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45859
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45859
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:32.205171 31849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:32.205505 31849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:32.205678 31849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:32.213100 31849 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:32.213230 31849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:32.213348 31849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:32.213439 31849 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:32.213510 31849 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:32.223838 31849 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45859
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:32.225212 31849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:32.226589 31849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:32.238989 31854 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:32.238950 31857 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:32.238912 31855 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:32.239938 31849 server_base.cc:1034] running on GCE node
I20260619 06:43:32.240830 31849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:32.242375 31849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:32.243608 31849 hybrid_clock.cc:648] HybridClock initialized: now 1781851412243559 us; error 49 us; skew 500 ppm
I20260619 06:43:32.244012 31849 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:32 dist-test-slave-7lz4 krb5kdc[31836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851412, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:32.247225 31849 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 06:43:32.248768 31849 webserver.cc:460] Webserver started at http://127.0.0.1:36493/ using document root <none> and password file <none>
I20260619 06:43:32.249518 31849 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:32.249675 31849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:32.249984 31849 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:32.253191 31849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "537ae9b9113b48aa86304bf2f4d6e295"
format_stamp: "Formatted at 2026-06-19 06:43:32 on dist-test-slave-7lz4"
server_key: "ad701e90c1b64e935f990830a14e10cc"
server_key_iv: "4f531b123ef1c568736e202a5727bc29"
server_key_version: "encryptionkey@0"
I20260619 06:43:32.254002 31849 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "537ae9b9113b48aa86304bf2f4d6e295"
format_stamp: "Formatted at 2026-06-19 06:43:32 on dist-test-slave-7lz4"
server_key: "ad701e90c1b64e935f990830a14e10cc"
server_key_iv: "4f531b123ef1c568736e202a5727bc29"
server_key_version: "encryptionkey@0"
I20260619 06:43:32.259555 31849 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260619 06:43:32.263413 31864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:32.264945 31849 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:43:32.265168 31849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "537ae9b9113b48aa86304bf2f4d6e295"
format_stamp: "Formatted at 2026-06-19 06:43:32 on dist-test-slave-7lz4"
server_key: "ad701e90c1b64e935f990830a14e10cc"
server_key_iv: "4f531b123ef1c568736e202a5727bc29"
server_key_version: "encryptionkey@0"
I20260619 06:43:32.265388 31849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:32.283416 31849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:32.288244 31849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:32.288550 31849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:32.307500 31849 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45859
I20260619 06:43:32.307523 31915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45859 every 8 connection(s)
I20260619 06:43:32.308998 31849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:32.311300 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 31849
I20260619 06:43:32.311496 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:32.312074 11009 external_mini_cluster.cc:1428] Setting key 875a34baeb9c64b975b3221a8b643ae6
I20260619 06:43:32.313683 31916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:32.325579 31919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:32.314035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52067 (local address 127.0.0.1:45859)
0619 06:43:32.314786 (+ 751us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:32.314803 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:32.314846 (+ 43us) server_negotiation.cc:407] Connection header received
0619 06:43:32.316592 (+ 1746us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:32.316615 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:32.317050 (+ 435us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:32.317517 (+ 467us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:32.318067 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:32.319463 (+ 1396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:32.320874 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:32.321578 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:32.321782 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:32.323067 (+ 1285us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:32.323075 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:32.323092 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:32.323822 (+ 730us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:32.323909 (+ 87us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:32.323940 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:32.324062 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:32.324265 (+ 203us) server_negotiation.cc:299] Negotiation successful
0619 06:43:32.324560 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":330,"threads_started":1}
I20260619 06:43:32.325793 31916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295: Bootstrap starting.
I20260619 06:43:32.329805 31916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:32.329841 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:43:32.330863 31916 log.cc:824] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:32.334195 31916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295: No bootstrap required, opened a new log
I20260619 06:43:32.341418 31919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:32.334217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35641 (local address 127.0.0.1:45859)
0619 06:43:32.334463 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:32.334473 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:32.334926 (+ 453us) server_negotiation.cc:407] Connection header received
0619 06:43:32.335109 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:32.335113 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:32.335175 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:32.335267 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:32.335955 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:32.336713 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:32.338690 (+ 1977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:32.339172 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:32.339271 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:32.340561 (+ 1290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:32.340567 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:32.340570 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:32.340590 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:32.340632 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:32.340652 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:32.340727 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:32.340897 (+ 170us) server_negotiation.cc:299] Negotiation successful
0619 06:43:32.340989 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260619 06:43:32.344992 31916 raft_consensus.cc:348] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "537ae9b9113b48aa86304bf2f4d6e295" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45859 } }
I20260619 06:43:32.345569 31916 raft_consensus.cc:374] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:32.345687 31916 raft_consensus.cc:729] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 537ae9b9113b48aa86304bf2f4d6e295, State: Initialized, Role: FOLLOWER
I20260619 06:43:32.346396 31916 consensus_queue.cc:260] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "537ae9b9113b48aa86304bf2f4d6e295" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45859 } }
I20260619 06:43:32.346654 31916 raft_consensus.cc:388] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:32.346814 31916 raft_consensus.cc:482] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:32.347003 31916 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:32.349784 31916 raft_consensus.cc:504] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "537ae9b9113b48aa86304bf2f4d6e295" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45859 } }
I20260619 06:43:32.350337 31916 leader_election.cc:302] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 537ae9b9113b48aa86304bf2f4d6e295; no voters:
I20260619 06:43:32.350929 31916 leader_election.cc:288] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:32.351069 31926 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:32.351788 31926 raft_consensus.cc:686] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295 [term 1 LEADER]: Becoming Leader. State: Replica: 537ae9b9113b48aa86304bf2f4d6e295, State: Running, Role: LEADER
I20260619 06:43:32.352325 31926 consensus_queue.cc:237] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "537ae9b9113b48aa86304bf2f4d6e295" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45859 } }
I20260619 06:43:32.353096 31916 sys_catalog.cc:564] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:32.355245 31928 sys_catalog.cc:455] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 537ae9b9113b48aa86304bf2f4d6e295. Latest consensus state: current_term: 1 leader_uuid: "537ae9b9113b48aa86304bf2f4d6e295" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "537ae9b9113b48aa86304bf2f4d6e295" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45859 } } }
I20260619 06:43:32.355485 31927 sys_catalog.cc:455] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "537ae9b9113b48aa86304bf2f4d6e295" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "537ae9b9113b48aa86304bf2f4d6e295" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45859 } } }
I20260619 06:43:32.355752 31928 sys_catalog.cc:458] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:32.355822 31927 sys_catalog.cc:458] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:32.357841 31933 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:32.363391 31933 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:32.373081 31933 catalog_manager.cc:1347] Generated new cluster ID: d1424269d26d4e55ad066a03bf62a01e
I20260619 06:43:32.373212 31933 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:32.397063 31933 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:32.399029 31933 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:32.408866 31933 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 537ae9b9113b48aa86304bf2f4d6e295: Generated new TSK 0
I20260619 06:43:32.410100 31933 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:32.424481 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 31849
W20260619 06:43:32.425702 31911 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:52067
W20260619 06:43:32.426465 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 31849: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:43:32.426628 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 31849
2026-06-19T06:43:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1938 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:32 dist-test-slave-7lz4 krb5kdc[31947](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:32 dist-test-slave-7lz4 krb5kdc[31947](info): set up 2 sockets
Jun 19 06:43:32 dist-test-slave-7lz4 krb5kdc[31947](info): commencing operation
krb5kdc: starting...
W20260619 06:43:33.540136 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.005s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:33 dist-test-slave-7lz4 krb5kdc[31947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 06:43:33.807744 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41281
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41281
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:34.150170 31960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:34.150494 31960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:34.150667 31960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:34.158227 31960 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:34.158370 31960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:34.158470 31960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:34.158566 31960 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:34.158664 31960 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:34.169246 31960 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41281
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:34.170730 31960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:34.172194 31960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:34.185155 31965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:34.185194 31968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:34.185160 31966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:34.186054 31960 server_base.cc:1034] running on GCE node
I20260619 06:43:34.187052 31960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:34.188786 31960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:34.190059 31960 hybrid_clock.cc:648] HybridClock initialized: now 1781851414190019 us; error 39 us; skew 500 ppm
I20260619 06:43:34.190459 31960 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:34 dist-test-slave-7lz4 krb5kdc[31947](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851414, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:34.198769 31960 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 06:43:34.200592 31960 webserver.cc:460] Webserver started at http://127.0.0.1:40539/ using document root <none> and password file <none>
I20260619 06:43:34.201390 31960 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:34.201553 31960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:34.201885 31960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:34.205145 31960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "9fc16034007048b99280a16d7f453223"
format_stamp: "Formatted at 2026-06-19 06:43:34 on dist-test-slave-7lz4"
server_key: "29bd53f161c7734e4347d8ea41f77da2"
server_key_iv: "bdd84160367d056408af9b14505d53b9"
server_key_version: "encryptionkey@0"
I20260619 06:43:34.205989 31960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "9fc16034007048b99280a16d7f453223"
format_stamp: "Formatted at 2026-06-19 06:43:34 on dist-test-slave-7lz4"
server_key: "29bd53f161c7734e4347d8ea41f77da2"
server_key_iv: "bdd84160367d056408af9b14505d53b9"
server_key_version: "encryptionkey@0"
I20260619 06:43:34.211725 31960 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260619 06:43:34.215600 31975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:34.217207 31960 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20260619 06:43:34.217422 31960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "9fc16034007048b99280a16d7f453223"
format_stamp: "Formatted at 2026-06-19 06:43:34 on dist-test-slave-7lz4"
server_key: "29bd53f161c7734e4347d8ea41f77da2"
server_key_iv: "bdd84160367d056408af9b14505d53b9"
server_key_version: "encryptionkey@0"
I20260619 06:43:34.217662 31960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:34.223935 31960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:34.228366 31960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:34.228724 31960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:34.247756 31960 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41281
I20260619 06:43:34.247797 32026 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41281 every 8 connection(s)
I20260619 06:43:34.249243 31960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:34.253146 32027 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:34.254210 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 31960
I20260619 06:43:34.254400 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:34.254835 11009 external_mini_cluster.cc:1428] Setting key 039779db4bed5964696df2c06bdd5788
I20260619 06:43:34.264182 32030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:34.256852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35893 (local address 127.0.0.1:41281)
0619 06:43:34.257706 (+ 854us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:34.257722 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:34.257777 (+ 55us) server_negotiation.cc:407] Connection header received
0619 06:43:34.260016 (+ 2239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:34.260047 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:34.260560 (+ 513us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:34.261032 (+ 472us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:34.262064 (+ 1032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:34.262072 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:34.262090 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:34.262106 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:34.262172 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:34.262276 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:34.262525 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:34.262647 (+ 122us) server_negotiation.cc:299] Negotiation successful
0619 06:43:34.262871 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":559,"thread_start_us":337,"threads_started":1}
I20260619 06:43:34.267992 32027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223: Bootstrap starting.
I20260619 06:43:34.268152 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:43:34.271165 32027 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:34.272282 32027 log.cc:824] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:34.275229 32030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:34.272679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49339 (local address 127.0.0.1:41281)
0619 06:43:34.272879 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:34.272888 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:34.273273 (+ 385us) server_negotiation.cc:407] Connection header received
0619 06:43:34.273417 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:34.273425 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:34.273495 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:34.273622 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:34.274558 (+ 936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:34.274564 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:34.274569 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:34.274588 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:34.274635 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:34.274651 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:34.274768 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:34.274900 (+ 132us) server_negotiation.cc:299] Negotiation successful
0619 06:43:34.274962 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260619 06:43:34.275569 32027 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223: No bootstrap required, opened a new log
I20260619 06:43:34.283862 32027 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fc16034007048b99280a16d7f453223" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41281 } }
I20260619 06:43:34.284344 32027 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:34.284467 32027 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fc16034007048b99280a16d7f453223, State: Initialized, Role: FOLLOWER
I20260619 06:43:34.285096 32027 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fc16034007048b99280a16d7f453223" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41281 } }
I20260619 06:43:34.285324 32027 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:34.285430 32027 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:34.285566 32027 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:34.287889 32027 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fc16034007048b99280a16d7f453223" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41281 } }
I20260619 06:43:34.288378 32027 leader_election.cc:302] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9fc16034007048b99280a16d7f453223; no voters:
I20260619 06:43:34.289000 32027 leader_election.cc:288] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:34.289161 32037 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:34.289844 32037 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223 [term 1 LEADER]: Becoming Leader. State: Replica: 9fc16034007048b99280a16d7f453223, State: Running, Role: LEADER
I20260619 06:43:34.290551 32037 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fc16034007048b99280a16d7f453223" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41281 } }
I20260619 06:43:34.291297 32027 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:34.293723 32039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9fc16034007048b99280a16d7f453223. Latest consensus state: current_term: 1 leader_uuid: "9fc16034007048b99280a16d7f453223" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fc16034007048b99280a16d7f453223" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41281 } } }
I20260619 06:43:34.293694 32038 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9fc16034007048b99280a16d7f453223" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9fc16034007048b99280a16d7f453223" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41281 } } }
I20260619 06:43:34.294190 32038 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:34.294188 32039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:34.296657 32045 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:34.302155 32045 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:34.311157 32045 catalog_manager.cc:1347] Generated new cluster ID: e38092189b214343a8f95c487021eade
I20260619 06:43:34.311319 32045 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:34.327988 32045 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:34.328504 32045 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:34.340996 32045 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9fc16034007048b99280a16d7f453223: Generated new TSK 0
I20260619 06:43:34.342227 32045 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:34.348382 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 31960
W20260619 06:43:34.349717 32022 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:35893
W20260619 06:43:34.350507 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 31960: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:43:34.350674 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 31960
2026-06-19T06:43:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1923 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:34 dist-test-slave-7lz4 krb5kdc[32058](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:34 dist-test-slave-7lz4 krb5kdc[32058](info): set up 2 sockets
Jun 19 06:43:34 dist-test-slave-7lz4 krb5kdc[32058](info): commencing operation
krb5kdc: starting...
W20260619 06:43:35.484158 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.005s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:35 dist-test-slave-7lz4 krb5kdc[32058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851415, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 06:43:35.749195 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32793
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32793
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:36.101562 32071 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:36.101972 32071 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:36.102147 32071 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:36.109848 32071 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:36.110059 32071 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:36.110198 32071 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:36.110325 32071 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:36.110410 32071 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:36.121162 32071 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32793
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32793
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:36.122650 32071 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:36.124241 32071 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:36.137282 32076 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:36.137394 32079 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:36.137398 32077 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:36.138248 32071 server_base.cc:1034] running on GCE node
I20260619 06:43:36.139122 32071 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:36.140761 32071 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:36.142020 32071 hybrid_clock.cc:648] HybridClock initialized: now 1781851416141991 us; error 60 us; skew 500 ppm
I20260619 06:43:36.142395 32071 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:36 dist-test-slave-7lz4 krb5kdc[32058](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851416, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:36.145987 32071 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 06:43:36.147619 32071 webserver.cc:460] Webserver started at http://127.0.0.1:44759/ using document root <none> and password file <none>
I20260619 06:43:36.148412 32071 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:36.148571 32071 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:36.148898 32071 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:36.152217 32071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "72a55ea72ef34d7d9e51b217f91787ca"
format_stamp: "Formatted at 2026-06-19 06:43:36 on dist-test-slave-7lz4"
server_key: "4195078ab714a1332f2531a8d53e7dc7"
server_key_iv: "c53eb7697b3212e952292b3dabd5ccac"
server_key_version: "encryptionkey@0"
I20260619 06:43:36.153048 32071 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "72a55ea72ef34d7d9e51b217f91787ca"
format_stamp: "Formatted at 2026-06-19 06:43:36 on dist-test-slave-7lz4"
server_key: "4195078ab714a1332f2531a8d53e7dc7"
server_key_iv: "c53eb7697b3212e952292b3dabd5ccac"
server_key_version: "encryptionkey@0"
I20260619 06:43:36.158532 32071 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260619 06:43:36.162214 32086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:36.163693 32071 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260619 06:43:36.163926 32071 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "72a55ea72ef34d7d9e51b217f91787ca"
format_stamp: "Formatted at 2026-06-19 06:43:36 on dist-test-slave-7lz4"
server_key: "4195078ab714a1332f2531a8d53e7dc7"
server_key_iv: "c53eb7697b3212e952292b3dabd5ccac"
server_key_version: "encryptionkey@0"
I20260619 06:43:36.164143 32071 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:36.206090 32071 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:36.210556 32071 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:36.210891 32071 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:36.230284 32071 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32793
I20260619 06:43:36.230325 32137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32793 every 8 connection(s)
I20260619 06:43:36.231835 32071 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:36.235790 32138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:36.236380 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 32071
I20260619 06:43:36.236573 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:36.237044 11009 external_mini_cluster.cc:1428] Setting key 6bbf2da09d3e8b19050f1b82ff1457ed
I20260619 06:43:36.250205 32138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca: Bootstrap starting.
Jun 19 06:43:36 dist-test-slave-7lz4 krb5kdc[32058](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851415, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260619 06:43:36.254042 32138 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:36.255143 32138 log.cc:824] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:36.258289 32138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca: No bootstrap required, opened a new log
I20260619 06:43:36.261902 32141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:36.238890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.144:52261 (local address 127.0.0.1:32793)
0619 06:43:36.239747 (+ 857us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:36.239759 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:36.239813 (+ 54us) server_negotiation.cc:407] Connection header received
0619 06:43:36.241899 (+ 2086us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:36.241927 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:36.242397 (+ 470us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:36.242764 (+ 367us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:36.244674 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:36.246033 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:36.248007 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:36.248853 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:36.248992 (+ 139us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:36.253961 (+ 4969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:36.253977 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:36.253994 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:36.254039 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:36.257549 (+ 3510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:36.258407 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:36.258416 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:36.258425 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:36.258609 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:36.259099 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:36.259102 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:36.259104 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:36.259610 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:36.260040 (+ 430us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:36.260520 (+ 480us) server_negotiation.cc:299] Negotiation successful
0619 06:43:36.260845 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":371,"threads_started":1}
I20260619 06:43:36.266232 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:43:36.266809 32138 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72a55ea72ef34d7d9e51b217f91787ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32793 } }
I20260619 06:43:36.267203 32138 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:36.267313 32138 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72a55ea72ef34d7d9e51b217f91787ca, State: Initialized, Role: FOLLOWER
I20260619 06:43:36.267961 32138 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72a55ea72ef34d7d9e51b217f91787ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32793 } }
I20260619 06:43:36.268242 32138 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:36.268388 32138 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:36.268558 32138 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:36.270989 32138 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72a55ea72ef34d7d9e51b217f91787ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32793 } }
I20260619 06:43:36.271538 32138 leader_election.cc:302] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72a55ea72ef34d7d9e51b217f91787ca; no voters:
I20260619 06:43:36.276013 32138 leader_election.cc:288] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:36.276134 32148 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:36.277578 32148 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca [term 1 LEADER]: Becoming Leader. State: Replica: 72a55ea72ef34d7d9e51b217f91787ca, State: Running, Role: LEADER
I20260619 06:43:36.278277 32148 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72a55ea72ef34d7d9e51b217f91787ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32793 } }
I20260619 06:43:36.278697 32138 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:36.281911 32149 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72a55ea72ef34d7d9e51b217f91787ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72a55ea72ef34d7d9e51b217f91787ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32793 } } }
I20260619 06:43:36.282394 32149 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:36.283205 32150 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72a55ea72ef34d7d9e51b217f91787ca. Latest consensus state: current_term: 1 leader_uuid: "72a55ea72ef34d7d9e51b217f91787ca" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72a55ea72ef34d7d9e51b217f91787ca" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32793 } } }
I20260619 06:43:36.283649 32150 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:36.287884 32153 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:36.292711 32141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:36.271993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.144:44049 (local address 127.0.0.1:32793)
0619 06:43:36.272237 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:36.272244 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:36.272722 (+ 478us) server_negotiation.cc:407] Connection header received
0619 06:43:36.272928 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:36.272932 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:36.273003 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:36.273096 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:36.275499 (+ 2403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:36.276848 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:36.278713 (+ 1865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:36.279280 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:36.279438 (+ 158us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:36.283179 (+ 3741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:36.283191 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:36.283198 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:36.283245 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:36.288129 (+ 4884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:36.289417 (+ 1288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:36.289424 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:36.289427 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:36.289629 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:36.290314 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:36.290323 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:36.290328 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:36.290897 (+ 569us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:36.291205 (+ 308us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:36.291832 (+ 627us) server_negotiation.cc:299] Negotiation successful
0619 06:43:36.292107 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":82}
I20260619 06:43:36.293934 32153 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:36.307329 32153 catalog_manager.cc:1347] Generated new cluster ID: c5a97285fec047ad9bfbaacfccf4efed
I20260619 06:43:36.307755 32153 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:36.318782 32153 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:36.320269 32153 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:36.330929 32153 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72a55ea72ef34d7d9e51b217f91787ca: Generated new TSK 0
I20260619 06:43:36.331869 32153 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:36.344208 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 32071
I20260619 06:43:36.345594 32133 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:36.437114 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 32071
W20260619 06:43:36.454252 32056 connection.cc:535] client connection to 127.0.0.1:32793 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:32793): Connection reset by peer (error 104)
2026-06-19T06:43:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2086 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:36 dist-test-slave-7lz4 krb5kdc[32170](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:36 dist-test-slave-7lz4 krb5kdc[32170](info): set up 2 sockets
Jun 19 06:43:36 dist-test-slave-7lz4 krb5kdc[32170](info): commencing operation
krb5kdc: starting...
W20260619 06:43:37.544096 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.004s sys 0.024s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:37 dist-test-slave-7lz4 krb5kdc[32170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851417, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 06:43:37.803069 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34963
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34839
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34963
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:38.137595 32183 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:38.137902 32183 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:38.138164 32183 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:38.145675 32183 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:38.145812 32183 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:38.145937 32183 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:38.146051 32183 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:38.146127 32183 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:38.156229 32183 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34839
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34963
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:38.157634 32183 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:38.159087 32183 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:38.171531 32189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:38.171620 32188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:38.171598 32191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:38.172902 32183 server_base.cc:1034] running on GCE node
I20260619 06:43:38.173758 32183 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:38.175225 32183 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:38.176434 32183 hybrid_clock.cc:648] HybridClock initialized: now 1781851418176374 us; error 51 us; skew 500 ppm
I20260619 06:43:38.176795 32183 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:38 dist-test-slave-7lz4 krb5kdc[32170](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851418, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:38.180050 32183 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 06:43:38.181499 32183 webserver.cc:460] Webserver started at http://127.0.0.1:36317/ using document root <none> and password file <none>
I20260619 06:43:38.182180 32183 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:38.182322 32183 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:38.182632 32183 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:38.185596 32183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "331ef461123f46b8a2b3aa12e336b012"
format_stamp: "Formatted at 2026-06-19 06:43:38 on dist-test-slave-7lz4"
server_key: "8ce929b701378e69bf3512c7c771dcad"
server_key_iv: "5d01f57782d95168064f18ea8308db1d"
server_key_version: "encryptionkey@0"
I20260619 06:43:38.186378 32183 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "331ef461123f46b8a2b3aa12e336b012"
format_stamp: "Formatted at 2026-06-19 06:43:38 on dist-test-slave-7lz4"
server_key: "8ce929b701378e69bf3512c7c771dcad"
server_key_iv: "5d01f57782d95168064f18ea8308db1d"
server_key_version: "encryptionkey@0"
I20260619 06:43:38.191536 32183 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260619 06:43:38.194983 32198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:38.196319 32183 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:43:38.196496 32183 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "331ef461123f46b8a2b3aa12e336b012"
format_stamp: "Formatted at 2026-06-19 06:43:38 on dist-test-slave-7lz4"
server_key: "8ce929b701378e69bf3512c7c771dcad"
server_key_iv: "5d01f57782d95168064f18ea8308db1d"
server_key_version: "encryptionkey@0"
I20260619 06:43:38.196691 32183 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:38.214105 32183 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:38.218827 32183 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:38.219126 32183 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:38.237783 32183 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34963
I20260619 06:43:38.237818 32249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34963 every 8 connection(s)
I20260619 06:43:38.239173 32183 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:38.243003 32250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:38.248778 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 32183
I20260619 06:43:38.248999 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:38.249441 11009 external_mini_cluster.cc:1428] Setting key a6c3039d2b1da443951f38eded5bf687
I20260619 06:43:38.254509 32250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012: Bootstrap starting.
I20260619 06:43:38.257925 32250 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:38.258953 32250 log.cc:824] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:38.261752 32250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012: No bootstrap required, opened a new log
I20260619 06:43:38.262895 32253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:38.251526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.144:53787 (local address 127.0.0.1:34963)
0619 06:43:38.252454 (+ 928us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:38.252466 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:38.252513 (+ 47us) server_negotiation.cc:407] Connection header received
0619 06:43:38.254260 (+ 1747us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:38.254283 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:38.254785 (+ 502us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:38.255195 (+ 410us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:38.255758 (+ 563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:38.257070 (+ 1312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:38.258441 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:38.259173 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:38.259356 (+ 183us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:38.260598 (+ 1242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:38.260605 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:38.260619 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:38.261153 (+ 534us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:38.261225 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:38.261248 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:38.261409 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:38.261749 (+ 340us) server_negotiation.cc:299] Negotiation successful
0619 06:43:38.261951 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":702,"thread_start_us":438,"threads_started":1}
I20260619 06:43:38.266759 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:43:38.269804 32250 raft_consensus.cc:348] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "331ef461123f46b8a2b3aa12e336b012" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34963 } }
I20260619 06:43:38.270224 32250 raft_consensus.cc:374] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:38.270351 32250 raft_consensus.cc:729] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 331ef461123f46b8a2b3aa12e336b012, State: Initialized, Role: FOLLOWER
I20260619 06:43:38.270942 32250 consensus_queue.cc:260] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "331ef461123f46b8a2b3aa12e336b012" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34963 } }
I20260619 06:43:38.271261 32250 raft_consensus.cc:388] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:38.271432 32250 raft_consensus.cc:482] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:38.271740 32250 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:38.274115 32250 raft_consensus.cc:504] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "331ef461123f46b8a2b3aa12e336b012" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34963 } }
I20260619 06:43:38.274605 32250 leader_election.cc:302] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 331ef461123f46b8a2b3aa12e336b012; no voters:
I20260619 06:43:38.275285 32250 leader_election.cc:288] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:38.275437 32260 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:38.277969 32250 sys_catalog.cc:564] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:38.278297 32253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:38.271395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.144:43787 (local address 127.0.0.1:34963)
0619 06:43:38.271595 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:38.271603 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:38.271982 (+ 379us) server_negotiation.cc:407] Connection header received
0619 06:43:38.272188 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:38.272193 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:38.272278 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:38.272392 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:38.272904 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:38.273665 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:38.275262 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:38.276072 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:38.276805 (+ 733us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:38.277419 (+ 614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:38.277423 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:38.277426 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:38.277454 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:38.277512 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:38.277528 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:38.277656 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:38.277853 (+ 197us) server_negotiation.cc:299] Negotiation successful
0619 06:43:38.277904 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260619 06:43:38.282435 32260 raft_consensus.cc:686] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012 [term 1 LEADER]: Becoming Leader. State: Replica: 331ef461123f46b8a2b3aa12e336b012, State: Running, Role: LEADER
I20260619 06:43:38.283304 32260 consensus_queue.cc:237] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "331ef461123f46b8a2b3aa12e336b012" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34963 } }
I20260619 06:43:38.286674 32262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 331ef461123f46b8a2b3aa12e336b012. Latest consensus state: current_term: 1 leader_uuid: "331ef461123f46b8a2b3aa12e336b012" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "331ef461123f46b8a2b3aa12e336b012" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34963 } } }
I20260619 06:43:38.286777 32261 sys_catalog.cc:455] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "331ef461123f46b8a2b3aa12e336b012" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "331ef461123f46b8a2b3aa12e336b012" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34963 } } }
I20260619 06:43:38.287102 32261 sys_catalog.cc:458] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:38.287102 32262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012 [sys.catalog]: This master's current role is: LEADER
W20260619 06:43:38.301141 32274 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 06:43:38.301311 32274 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 06:43:38.301466 32275 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:38.303653 32275 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:38.312796 32275 catalog_manager.cc:1347] Generated new cluster ID: 7d67b4685d464b96b89c42b3578ec657
I20260619 06:43:38.312938 32275 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:38.331279 32275 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:38.332661 32275 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:38.341169 32275 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 331ef461123f46b8a2b3aa12e336b012: Generated new TSK 0
I20260619 06:43:38.342015 32275 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:38.351426 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 32183
W20260619 06:43:38.352661 32245 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.144:53787
W20260619 06:43:38.353518 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 32183: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:43:38.353691 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 32183
W20260619 06:43:38.370560 32168 connection.cc:535] client connection to 127.0.0.1:34963 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34963): Connection reset by peer (error 104)
2026-06-19T06:43:38Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1916 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:38 dist-test-slave-7lz4 krb5kdc[32281](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:38 dist-test-slave-7lz4 krb5kdc[32281](info): set up 2 sockets
Jun 19 06:43:38 dist-test-slave-7lz4 krb5kdc[32281](info): commencing operation
krb5kdc: starting...
W20260619 06:43:39.460197 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.070s user 0.003s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:39 dist-test-slave-7lz4 krb5kdc[32281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851419, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 06:43:39.720803 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41021
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43361
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41021
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:40.051265 32294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:40.051563 32294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:40.051759 32294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:40.059049 32294 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:40.059166 32294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:40.059212 32294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:40.059295 32294 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:40.059360 32294 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:40.069408 32294 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43361
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41021
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:40.070729 32294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:40.072152 32294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:40.084053 32299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:40.083963 32302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:40.084007 32300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:40.084988 32294 server_base.cc:1034] running on GCE node
I20260619 06:43:40.085767 32294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:40.087158 32294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:40.088366 32294 hybrid_clock.cc:648] HybridClock initialized: now 1781851420088312 us; error 40 us; skew 500 ppm
I20260619 06:43:40.088740 32294 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:40 dist-test-slave-7lz4 krb5kdc[32281](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851420, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:40.097131 32294 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 06:43:40.098714 32294 webserver.cc:460] Webserver started at http://127.0.0.1:42307/ using document root <none> and password file <none>
I20260619 06:43:40.099442 32294 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:40.099581 32294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:40.099937 32294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:40.102952 32294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "ec48a8ee761b476bbaeacf20a899d2a2"
format_stamp: "Formatted at 2026-06-19 06:43:40 on dist-test-slave-7lz4"
server_key: "5956507a3be51f2fdc64a275b455e898"
server_key_iv: "53f23c025464c2001b200b761f6ad267"
server_key_version: "encryptionkey@0"
I20260619 06:43:40.103820 32294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "ec48a8ee761b476bbaeacf20a899d2a2"
format_stamp: "Formatted at 2026-06-19 06:43:40 on dist-test-slave-7lz4"
server_key: "5956507a3be51f2fdc64a275b455e898"
server_key_iv: "53f23c025464c2001b200b761f6ad267"
server_key_version: "encryptionkey@0"
I20260619 06:43:40.109042 32294 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s
I20260619 06:43:40.112668 32309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:40.113999 32294 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:43:40.114185 32294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "ec48a8ee761b476bbaeacf20a899d2a2"
format_stamp: "Formatted at 2026-06-19 06:43:40 on dist-test-slave-7lz4"
server_key: "5956507a3be51f2fdc64a275b455e898"
server_key_iv: "53f23c025464c2001b200b761f6ad267"
server_key_version: "encryptionkey@0"
I20260619 06:43:40.114406 32294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:40.120285 32294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:40.124461 32294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:40.124773 32294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:40.143759 32294 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41021
I20260619 06:43:40.143868 32360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41021 every 8 connection(s)
I20260619 06:43:40.145179 32294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:40.146260 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 32294
I20260619 06:43:40.146476 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:40.146912 11009 external_mini_cluster.cc:1428] Setting key 737c7a5011cf3505f64e885f9e7fc2b2
I20260619 06:43:40.149662 32361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:40.155916 32364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:40.148819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.144:35025 (local address 127.0.0.1:41021)
0619 06:43:40.149611 (+ 792us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:40.149627 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:40.149683 (+ 56us) server_negotiation.cc:407] Connection header received
0619 06:43:40.152023 (+ 2340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:40.152049 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:40.152480 (+ 431us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:40.152935 (+ 455us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:40.153911 (+ 976us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:40.153919 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:40.153937 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:40.153960 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:40.154046 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:40.154079 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:40.154302 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:40.154429 (+ 127us) server_negotiation.cc:299] Negotiation successful
0619 06:43:40.154631 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":536,"thread_start_us":307,"threads_started":1}
I20260619 06:43:40.159456 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:43:40.162254 32361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2: Bootstrap starting.
I20260619 06:43:40.165915 32361 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:40.166383 32364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:40.163916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.144:37877 (local address 127.0.0.1:41021)
0619 06:43:40.164134 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:40.164145 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:40.164468 (+ 323us) server_negotiation.cc:407] Connection header received
0619 06:43:40.164667 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:40.164672 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:40.164717 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:40.164818 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:40.165729 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:40.165734 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:40.165740 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:40.165757 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:40.165804 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:40.165819 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:40.165950 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:40.166034 (+ 84us) server_negotiation.cc:299] Negotiation successful
0619 06:43:40.166097 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260619 06:43:40.167168 32361 log.cc:824] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:40.169826 32361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2: No bootstrap required, opened a new log
I20260619 06:43:40.177373 32361 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec48a8ee761b476bbaeacf20a899d2a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41021 } }
I20260619 06:43:40.177780 32361 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:40.177889 32361 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec48a8ee761b476bbaeacf20a899d2a2, State: Initialized, Role: FOLLOWER
I20260619 06:43:40.178452 32361 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec48a8ee761b476bbaeacf20a899d2a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41021 } }
I20260619 06:43:40.178684 32361 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:40.178828 32361 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:40.178992 32361 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:40.181214 32361 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec48a8ee761b476bbaeacf20a899d2a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41021 } }
I20260619 06:43:40.181708 32361 leader_election.cc:302] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec48a8ee761b476bbaeacf20a899d2a2; no voters:
I20260619 06:43:40.182241 32361 leader_election.cc:288] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:40.182384 32371 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:40.183059 32371 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2 [term 1 LEADER]: Becoming Leader. State: Replica: ec48a8ee761b476bbaeacf20a899d2a2, State: Running, Role: LEADER
I20260619 06:43:40.183676 32371 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec48a8ee761b476bbaeacf20a899d2a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41021 } }
I20260619 06:43:40.184376 32361 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:40.186615 32372 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec48a8ee761b476bbaeacf20a899d2a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec48a8ee761b476bbaeacf20a899d2a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41021 } } }
I20260619 06:43:40.187033 32372 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:40.186924 32373 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec48a8ee761b476bbaeacf20a899d2a2. Latest consensus state: current_term: 1 leader_uuid: "ec48a8ee761b476bbaeacf20a899d2a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec48a8ee761b476bbaeacf20a899d2a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41021 } } }
I20260619 06:43:40.187309 32373 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:40.189265 32379 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:40.194379 32379 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:40.203302 32379 catalog_manager.cc:1347] Generated new cluster ID: 50d1ddac7d714cd3a222d004684a12a1
I20260619 06:43:40.203433 32379 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:40.236480 32379 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:40.237031 32379 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:40.249169 32379 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec48a8ee761b476bbaeacf20a899d2a2: Generated new TSK 0
I20260619 06:43:40.250097 32379 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:40.258221 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 32294
W20260619 06:43:40.259438 32356 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.144:35025
W20260619 06:43:40.260247 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 32294: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:43:40.260413 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 32294
2026-06-19T06:43:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1906 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:40 dist-test-slave-7lz4 krb5kdc[32392](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:40 dist-test-slave-7lz4 krb5kdc[32392](info): set up 2 sockets
Jun 19 06:43:40 dist-test-slave-7lz4 krb5kdc[32392](info): commencing operation
krb5kdc: starting...
W20260619 06:43:41.372186 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:41 dist-test-slave-7lz4 krb5kdc[32392](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851421, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 06:43:41.628100 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32925
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32925
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:41.964640 32405 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:41.964969 32405 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:41.965060 32405 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:41.973182 32405 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:41.973307 32405 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:41.973353 32405 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:41.973407 32405 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:41.973456 32405 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:41.983619 32405 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32925
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:41.984988 32405 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:41.986279 32405 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:41.998589 32410 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:41.998618 32411 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:41.998998 32413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:42.000092 32405 server_base.cc:1034] running on GCE node
I20260619 06:43:42.000977 32405 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:42.002574 32405 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:42.003769 32405 hybrid_clock.cc:648] HybridClock initialized: now 1781851422003720 us; error 28 us; skew 500 ppm
I20260619 06:43:42.004108 32405 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:42 dist-test-slave-7lz4 krb5kdc[32392](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851422, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:42.008181 32405 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 06:43:42.010021 32405 webserver.cc:460] Webserver started at http://127.0.0.1:35541/ using document root <none> and password file <none>
I20260619 06:43:42.010726 32405 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:42.010840 32405 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:42.011112 32405 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:42.014354 32405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "a07b7045f5fe4792ad0446c3b5089fdd"
format_stamp: "Formatted at 2026-06-19 06:43:42 on dist-test-slave-7lz4"
server_key: "e531dfca0483d0cbed1cf7afec88970d"
server_key_iv: "5724e5fbd30c5f68bb1b36e4efaa6604"
server_key_version: "encryptionkey@0"
I20260619 06:43:42.015256 32405 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "a07b7045f5fe4792ad0446c3b5089fdd"
format_stamp: "Formatted at 2026-06-19 06:43:42 on dist-test-slave-7lz4"
server_key: "e531dfca0483d0cbed1cf7afec88970d"
server_key_iv: "5724e5fbd30c5f68bb1b36e4efaa6604"
server_key_version: "encryptionkey@0"
I20260619 06:43:42.020882 32405 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.002s
I20260619 06:43:42.024561 32420 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:42.026017 32405 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:43:42.026226 32405 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "a07b7045f5fe4792ad0446c3b5089fdd"
format_stamp: "Formatted at 2026-06-19 06:43:42 on dist-test-slave-7lz4"
server_key: "e531dfca0483d0cbed1cf7afec88970d"
server_key_iv: "5724e5fbd30c5f68bb1b36e4efaa6604"
server_key_version: "encryptionkey@0"
I20260619 06:43:42.026437 32405 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:42.068152 32405 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:42.072693 32405 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:42.073004 32405 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:42.092448 32405 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32925
I20260619 06:43:42.092506 32471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32925 every 8 connection(s)
I20260619 06:43:42.093924 32405 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:42.098120 32472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:42.104319 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 32405
I20260619 06:43:42.104538 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:42.105059 11009 external_mini_cluster.cc:1428] Setting key cf1bf5e02ea9fae1c736dd85c6a2bd27
I20260619 06:43:42.109505 32472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd: Bootstrap starting.
I20260619 06:43:42.113435 32472 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:42.114717 32472 log.cc:824] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:42.117782 32472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd: No bootstrap required, opened a new log
Jun 19 06:43:42 dist-test-slave-7lz4 krb5kdc[32392](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851421, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260619 06:43:42.125712 32472 raft_consensus.cc:348] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a07b7045f5fe4792ad0446c3b5089fdd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32925 } }
I20260619 06:43:42.126152 32472 raft_consensus.cc:374] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:42.126268 32472 raft_consensus.cc:729] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a07b7045f5fe4792ad0446c3b5089fdd, State: Initialized, Role: FOLLOWER
I20260619 06:43:42.126972 32472 consensus_queue.cc:260] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a07b7045f5fe4792ad0446c3b5089fdd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32925 } }
I20260619 06:43:42.127252 32472 raft_consensus.cc:388] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:42.127417 32472 raft_consensus.cc:482] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:42.127619 32472 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:42.129309 32475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:42.107165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.144:33039 (local address 127.0.0.1:32925)
0619 06:43:42.108053 (+ 888us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:42.108065 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:42.108110 (+ 45us) server_negotiation.cc:407] Connection header received
0619 06:43:42.109935 (+ 1825us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:42.109960 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:42.110408 (+ 448us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:42.110732 (+ 324us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:42.112593 (+ 1861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:42.114052 (+ 1459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:42.115938 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:42.116634 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:42.116853 (+ 219us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:42.121246 (+ 4393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:42.121255 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:42.121271 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:42.121325 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:42.124733 (+ 3408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:42.125623 (+ 890us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:42.125630 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:42.125637 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:42.125814 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:42.126366 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:42.126370 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:42.126372 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:42.126943 (+ 571us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:42.127317 (+ 374us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:42.127839 (+ 522us) server_negotiation.cc:299] Negotiation successful
0619 06:43:42.128174 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":668,"thread_start_us":407,"threads_started":1}
I20260619 06:43:42.130635 32472 raft_consensus.cc:504] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a07b7045f5fe4792ad0446c3b5089fdd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32925 } }
I20260619 06:43:42.131223 32472 leader_election.cc:302] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a07b7045f5fe4792ad0446c3b5089fdd; no voters:
I20260619 06:43:42.131928 32472 leader_election.cc:288] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:42.132057 32477 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:42.134268 32472 sys_catalog.cc:564] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:42.134820 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:43:42.138903 32477 raft_consensus.cc:686] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd [term 1 LEADER]: Becoming Leader. State: Replica: a07b7045f5fe4792ad0446c3b5089fdd, State: Running, Role: LEADER
I20260619 06:43:42.139717 32477 consensus_queue.cc:237] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a07b7045f5fe4792ad0446c3b5089fdd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32925 } }
I20260619 06:43:42.142478 32478 sys_catalog.cc:455] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a07b7045f5fe4792ad0446c3b5089fdd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a07b7045f5fe4792ad0446c3b5089fdd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32925 } } }
I20260619 06:43:42.142966 32478 sys_catalog.cc:458] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:42.143463 32479 sys_catalog.cc:455] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd [sys.catalog]: SysCatalogTable state changed. Reason: New leader a07b7045f5fe4792ad0446c3b5089fdd. Latest consensus state: current_term: 1 leader_uuid: "a07b7045f5fe4792ad0446c3b5089fdd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a07b7045f5fe4792ad0446c3b5089fdd" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32925 } } }
I20260619 06:43:42.143760 32479 sys_catalog.cc:458] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:42.146198 32488 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:42.152925 32488 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:42.168332 32488 catalog_manager.cc:1347] Generated new cluster ID: 3390a40ec7f0455e9e2d5ed25c9b4cee
I20260619 06:43:42.168593 32488 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:42.180280 32475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:42.148037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.144:56173 (local address 127.0.0.1:32925)
0619 06:43:42.148224 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:42.148230 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:42.159016 (+ 10786us) server_negotiation.cc:407] Connection header received
0619 06:43:42.159288 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:42.159294 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:42.159398 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:42.159526 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:42.161683 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:42.163032 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:42.164973 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:42.165649 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:42.165761 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:42.169259 (+ 3498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:42.169267 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:42.169272 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:42.169317 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:42.175053 (+ 5736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:42.176527 (+ 1474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:42.176537 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:42.176543 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:42.176751 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:42.177544 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:42.177552 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:42.177558 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:42.178100 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:42.178466 (+ 366us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:42.179390 (+ 924us) server_negotiation.cc:299] Negotiation successful
0619 06:43:42.179702 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":60}
I20260619 06:43:42.186336 32488 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:42.188426 32488 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:42.207254 32488 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a07b7045f5fe4792ad0446c3b5089fdd: Generated new TSK 0
I20260619 06:43:42.208333 32488 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:42.219089 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 32405
I20260619 06:43:42.220371 32467 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:42.317018 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 32405
W20260619 06:43:42.334563 32390 connection.cc:535] client connection to 127.0.0.1:32925 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:32925): Connection reset by peer (error 104)
2026-06-19T06:43:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2057 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:42 dist-test-slave-7lz4 krb5kdc[32505](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:42 dist-test-slave-7lz4 krb5kdc[32505](info): set up 2 sockets
Jun 19 06:43:42 dist-test-slave-7lz4 krb5kdc[32505](info): commencing operation
krb5kdc: starting...
W20260619 06:43:43.428356 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.074s user 0.001s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:43 dist-test-slave-7lz4 krb5kdc[32505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851423, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 06:43:43.692755 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35177
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35177
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:44.034286 32518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:44.034591 32518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:44.034791 32518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:44.042337 32518 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:44.042484 32518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:44.042596 32518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:44.042701 32518 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:44.042774 32518 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:44.052958 32518 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35177
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:44.054370 32518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:44.055737 32518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:44.067979 32523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:44.067950 32526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:44.067907 32524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:44.068846 32518 server_base.cc:1034] running on GCE node
I20260619 06:43:44.069591 32518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:44.071036 32518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:44.072259 32518 hybrid_clock.cc:648] HybridClock initialized: now 1781851424072214 us; error 58 us; skew 500 ppm
I20260619 06:43:44.072611 32518 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:44 dist-test-slave-7lz4 krb5kdc[32505](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851424, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:44.076292 32518 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 06:43:44.077827 32518 webserver.cc:460] Webserver started at http://127.0.0.1:41885/ using document root <none> and password file <none>
I20260619 06:43:44.078523 32518 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:44.078657 32518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:44.078962 32518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:44.082054 32518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "69e4523d33d748eba2dbc58eaaca4e61"
format_stamp: "Formatted at 2026-06-19 06:43:44 on dist-test-slave-7lz4"
server_key: "9691425f69a55d49e73c532fd6c08e53"
server_key_iv: "baeb830b65632fe991858c1090c94279"
server_key_version: "encryptionkey@0"
I20260619 06:43:44.082875 32518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "69e4523d33d748eba2dbc58eaaca4e61"
format_stamp: "Formatted at 2026-06-19 06:43:44 on dist-test-slave-7lz4"
server_key: "9691425f69a55d49e73c532fd6c08e53"
server_key_iv: "baeb830b65632fe991858c1090c94279"
server_key_version: "encryptionkey@0"
I20260619 06:43:44.088177 32518 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.005s
I20260619 06:43:44.091722 32533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:44.093212 32518 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:43:44.093437 32518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "69e4523d33d748eba2dbc58eaaca4e61"
format_stamp: "Formatted at 2026-06-19 06:43:44 on dist-test-slave-7lz4"
server_key: "9691425f69a55d49e73c532fd6c08e53"
server_key_iv: "baeb830b65632fe991858c1090c94279"
server_key_version: "encryptionkey@0"
I20260619 06:43:44.093665 32518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:44.107507 32518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:44.111904 32518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:44.112231 32518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:44.132392 32518 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35177
I20260619 06:43:44.132411 32584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35177 every 8 connection(s)
I20260619 06:43:44.133951 32518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:44.138104 32585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:44.139309 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 32518
I20260619 06:43:44.139496 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:44.140098 11009 external_mini_cluster.cc:1428] Setting key bcbb6875438f7763cd167905fceaa479
I20260619 06:43:44.152601 32585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61: Bootstrap starting.
I20260619 06:43:44.155987 32585 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:44.157125 32585 log.cc:824] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:44.160442 32588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:44.147831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.144:41173 (local address 127.0.0.1:35177)
0619 06:43:44.148656 (+ 825us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:44.148670 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:44.148713 (+ 43us) server_negotiation.cc:407] Connection header received
0619 06:43:44.151114 (+ 2401us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:44.151142 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:44.151619 (+ 477us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:44.152113 (+ 494us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:44.152728 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:44.154099 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:44.155537 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:44.156412 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:44.156634 (+ 222us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:44.158032 (+ 1398us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:44.158041 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:44.158059 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:44.158644 (+ 585us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:44.158724 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:44.158758 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:44.158926 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:44.159210 (+ 284us) server_negotiation.cc:299] Negotiation successful
0619 06:43:44.159391 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":342,"threads_started":1}
I20260619 06:43:44.160531 32585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61: No bootstrap required, opened a new log
I20260619 06:43:44.164551 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:43:44.169445 32585 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69e4523d33d748eba2dbc58eaaca4e61" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35177 } }
I20260619 06:43:44.169863 32585 raft_consensus.cc:374] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:44.170001 32585 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69e4523d33d748eba2dbc58eaaca4e61, State: Initialized, Role: FOLLOWER
I20260619 06:43:44.170779 32585 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69e4523d33d748eba2dbc58eaaca4e61" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35177 } }
I20260619 06:43:44.171061 32585 raft_consensus.cc:388] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:44.171233 32585 raft_consensus.cc:482] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:44.171434 32585 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:44.174788 32585 raft_consensus.cc:504] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69e4523d33d748eba2dbc58eaaca4e61" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35177 } }
I20260619 06:43:44.175536 32585 leader_election.cc:302] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 69e4523d33d748eba2dbc58eaaca4e61; no voters:
I20260619 06:43:44.176368 32588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:44.168920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.144:39589 (local address 127.0.0.1:35177)
0619 06:43:44.169124 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:44.169133 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:44.169500 (+ 367us) server_negotiation.cc:407] Connection header received
0619 06:43:44.169730 (+ 230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:44.169734 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:44.169827 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:44.169932 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:44.170659 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:44.171747 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:44.173614 (+ 1867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:44.174088 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:44.174183 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:44.175482 (+ 1299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:44.175487 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:44.175490 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:44.175508 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:44.175566 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:44.175582 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:44.175745 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:44.175919 (+ 174us) server_negotiation.cc:299] Negotiation successful
0619 06:43:44.175966 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260619 06:43:44.176445 32585 leader_election.cc:288] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:44.176558 32595 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:44.178179 32595 raft_consensus.cc:686] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61 [term 1 LEADER]: Becoming Leader. State: Replica: 69e4523d33d748eba2dbc58eaaca4e61, State: Running, Role: LEADER
I20260619 06:43:44.178886 32595 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69e4523d33d748eba2dbc58eaaca4e61" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35177 } }
I20260619 06:43:44.179121 32585 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:44.182066 32597 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69e4523d33d748eba2dbc58eaaca4e61. Latest consensus state: current_term: 1 leader_uuid: "69e4523d33d748eba2dbc58eaaca4e61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69e4523d33d748eba2dbc58eaaca4e61" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35177 } } }
I20260619 06:43:44.182462 32597 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:44.183007 32596 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "69e4523d33d748eba2dbc58eaaca4e61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69e4523d33d748eba2dbc58eaaca4e61" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35177 } } }
I20260619 06:43:44.183228 32596 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:44.187496 32601 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:44.193480 32601 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:44.203539 32601 catalog_manager.cc:1347] Generated new cluster ID: d8fa2049c4ee48cdb42a85e05be21ae3
I20260619 06:43:44.203715 32601 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:44.225055 32601 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:44.226518 32601 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:44.236670 32601 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 69e4523d33d748eba2dbc58eaaca4e61: Generated new TSK 0
I20260619 06:43:44.237589 32601 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:44.245625 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 32518
W20260619 06:43:44.246896 32580 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.144:41173
W20260619 06:43:44.247740 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 32518: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:43:44.247892 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 32518
W20260619 06:43:44.261829 32503 connection.cc:535] client connection to 127.0.0.1:35177 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35177): Connection reset by peer (error 104)
2026-06-19T06:43:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1927 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:44 dist-test-slave-7lz4 krb5kdc[32616](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:44 dist-test-slave-7lz4 krb5kdc[32616](info): set up 2 sockets
Jun 19 06:43:44 dist-test-slave-7lz4 krb5kdc[32616](info): commencing operation
krb5kdc: starting...
W20260619 06:43:45.368229 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.087s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:45 dist-test-slave-7lz4 krb5kdc[32616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851425, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260619 06:43:45.634953 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32949
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32949
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:45.974442 32629 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:45.974802 32629 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:45.974997 32629 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:45.982563 32629 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:45.982758 32629 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:45.982882 32629 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:45.982996 32629 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:45.983093 32629 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:45.993748 32629 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32949
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:45.995194 32629 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:45.996695 32629 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:46.009888 32634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:46.009909 32635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:46.010113 32637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:46.010718 32629 server_base.cc:1034] running on GCE node
I20260619 06:43:46.011583 32629 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:46.013206 32629 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:46.014484 32629 hybrid_clock.cc:648] HybridClock initialized: now 1781851426014424 us; error 44 us; skew 500 ppm
I20260619 06:43:46.014892 32629 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:46 dist-test-slave-7lz4 krb5kdc[32616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851426, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:46.026527 32629 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260619 06:43:46.028327 32629 webserver.cc:460] Webserver started at http://127.0.0.1:44733/ using document root <none> and password file <none>
I20260619 06:43:46.029068 32629 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:46.029223 32629 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:46.029556 32629 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:46.032861 32629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "4c5da43efef54cd0a272a93659e26ca9"
format_stamp: "Formatted at 2026-06-19 06:43:46 on dist-test-slave-7lz4"
server_key: "fb3beef31334f035d69caecb4aa3ee3a"
server_key_iv: "db73a1c1b1c84b07a3aa883a625cd747"
server_key_version: "encryptionkey@0"
I20260619 06:43:46.033677 32629 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "4c5da43efef54cd0a272a93659e26ca9"
format_stamp: "Formatted at 2026-06-19 06:43:46 on dist-test-slave-7lz4"
server_key: "fb3beef31334f035d69caecb4aa3ee3a"
server_key_iv: "db73a1c1b1c84b07a3aa883a625cd747"
server_key_version: "encryptionkey@0"
I20260619 06:43:46.039351 32629 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260619 06:43:46.043030 32644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:46.044550 32629 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s
I20260619 06:43:46.044745 32629 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "4c5da43efef54cd0a272a93659e26ca9"
format_stamp: "Formatted at 2026-06-19 06:43:46 on dist-test-slave-7lz4"
server_key: "fb3beef31334f035d69caecb4aa3ee3a"
server_key_iv: "db73a1c1b1c84b07a3aa883a625cd747"
server_key_version: "encryptionkey@0"
I20260619 06:43:46.044966 32629 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:46.051084 32629 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:46.055219 32629 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:46.055550 32629 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:46.074303 32629 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32949
I20260619 06:43:46.074326 32695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32949 every 8 connection(s)
I20260619 06:43:46.075865 32629 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:46.079793 32696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:46.080935 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 32629
I20260619 06:43:46.081125 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:46.081663 11009 external_mini_cluster.cc:1428] Setting key d111c4d9391eda1ffcb684e16089c410
I20260619 06:43:46.090109 32699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:46.083726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.144:34045 (local address 127.0.0.1:32949)
0619 06:43:46.084549 (+ 823us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:46.084561 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:46.084610 (+ 49us) server_negotiation.cc:407] Connection header received
0619 06:43:46.086494 (+ 1884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:46.086524 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:46.086940 (+ 416us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:46.087382 (+ 442us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:46.088481 (+ 1099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:46.088487 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:46.088501 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:46.088515 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:46.088568 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:46.088590 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:46.088840 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:46.088978 (+ 138us) server_negotiation.cc:299] Negotiation successful
0619 06:43:46.089170 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":589,"thread_start_us":338,"threads_started":1}
I20260619 06:43:46.094241 32696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9: Bootstrap starting.
I20260619 06:43:46.094355 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:43:46.097486 32696 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:46.098582 32696 log.cc:824] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:46.102020 32699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:46.099596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.144:41103 (local address 127.0.0.1:32949)
0619 06:43:46.099770 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:46.099775 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:46.100112 (+ 337us) server_negotiation.cc:407] Connection header received
0619 06:43:46.100296 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:46.100300 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:46.100355 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:46.100440 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:46.101365 (+ 925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:46.101369 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:46.101372 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:46.101387 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:46.101424 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:46.101439 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:46.101526 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:46.101677 (+ 151us) server_negotiation.cc:299] Negotiation successful
0619 06:43:46.101724 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260619 06:43:46.102396 32696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9: No bootstrap required, opened a new log
I20260619 06:43:46.111050 32696 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c5da43efef54cd0a272a93659e26ca9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32949 } }
I20260619 06:43:46.111470 32696 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:46.111582 32696 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c5da43efef54cd0a272a93659e26ca9, State: Initialized, Role: FOLLOWER
I20260619 06:43:46.112259 32696 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c5da43efef54cd0a272a93659e26ca9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32949 } }
I20260619 06:43:46.112505 32696 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:46.112658 32696 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:46.112870 32696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:46.115074 32696 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c5da43efef54cd0a272a93659e26ca9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32949 } }
I20260619 06:43:46.115598 32696 leader_election.cc:302] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c5da43efef54cd0a272a93659e26ca9; no voters:
I20260619 06:43:46.116320 32696 leader_election.cc:288] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:46.116467 32706 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:46.117142 32706 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9 [term 1 LEADER]: Becoming Leader. State: Replica: 4c5da43efef54cd0a272a93659e26ca9, State: Running, Role: LEADER
I20260619 06:43:46.117882 32706 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c5da43efef54cd0a272a93659e26ca9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32949 } }
I20260619 06:43:46.118690 32696 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:46.121210 32708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c5da43efef54cd0a272a93659e26ca9. Latest consensus state: current_term: 1 leader_uuid: "4c5da43efef54cd0a272a93659e26ca9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c5da43efef54cd0a272a93659e26ca9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32949 } } }
I20260619 06:43:46.121727 32708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:46.121199 32707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c5da43efef54cd0a272a93659e26ca9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c5da43efef54cd0a272a93659e26ca9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32949 } } }
I20260619 06:43:46.122575 32707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9 [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:46.123538 32715 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:46.128793 32715 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:46.138137 32715 catalog_manager.cc:1347] Generated new cluster ID: 890056aa30ec4c1bb11b59f4b5c7ae63
I20260619 06:43:46.138291 32715 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:46.151525 32715 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:46.152024 32715 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:46.160903 32715 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4c5da43efef54cd0a272a93659e26ca9: Generated new TSK 0
I20260619 06:43:46.161743 32715 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:46.171017 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 32629
W20260619 06:43:46.172225 32691 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.144:34045
W20260619 06:43:46.172989 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 32629: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:43:46.173143 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 32629
2026-06-19T06:43:46Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1928 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:46 dist-test-slave-7lz4 krb5kdc[32727](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:46 dist-test-slave-7lz4 krb5kdc[32727](info): set up 2 sockets
Jun 19 06:43:46 dist-test-slave-7lz4 krb5kdc[32727](info): commencing operation
krb5kdc: starting...
W20260619 06:43:47.280251 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.071s user 0.006s sys 0.021s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:47 dist-test-slave-7lz4 krb5kdc[32727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:43:47.546083 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:33859
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:34601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:33859
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:47.885818 32740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:47.886163 32740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:47.886276 32740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:47.893838 32740 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:47.893970 32740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:47.894016 32740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:47.894078 32740 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:47.894129 32740 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:47.904472 32740 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:34601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:33859
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:33859
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:47.905798 32740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:47.907141 32740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:47.919651 32746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:47.919694 32748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:47.919610 32745 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:47.920568 32740 server_base.cc:1034] running on GCE node
I20260619 06:43:47.921543 32740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:47.923071 32740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:47.924332 32740 hybrid_clock.cc:648] HybridClock initialized: now 1781851427924334 us; error 114 us; skew 500 ppm
I20260619 06:43:47.924752 32740 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:47 dist-test-slave-7lz4 krb5kdc[32727](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851427, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:47.927995 32740 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:43:47.929705 32740 webserver.cc:460] Webserver started at http://127.10.192.126:41185/ using document root <none> and password file <none>
I20260619 06:43:47.930413 32740 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:47.930516 32740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:47.930785 32740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:47.933921 32740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "f1b71493210e416a9e71c36a21e53e1a"
format_stamp: "Formatted at 2026-06-19 06:43:47 on dist-test-slave-7lz4"
server_key: "2a0b750b812a11c613b019a0380d6549"
server_key_iv: "1eae5046e06333db2d672af9839f55c2"
server_key_version: "encryptionkey@0"
I20260619 06:43:47.934682 32740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "f1b71493210e416a9e71c36a21e53e1a"
format_stamp: "Formatted at 2026-06-19 06:43:47 on dist-test-slave-7lz4"
server_key: "2a0b750b812a11c613b019a0380d6549"
server_key_iv: "1eae5046e06333db2d672af9839f55c2"
server_key_version: "encryptionkey@0"
I20260619 06:43:47.940335 32740 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260619 06:43:47.944114 32755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:47.945647 32740 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:43:47.945874 32740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "f1b71493210e416a9e71c36a21e53e1a"
format_stamp: "Formatted at 2026-06-19 06:43:47 on dist-test-slave-7lz4"
server_key: "2a0b750b812a11c613b019a0380d6549"
server_key_iv: "1eae5046e06333db2d672af9839f55c2"
server_key_version: "encryptionkey@0"
I20260619 06:43:47.946094 32740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:47.970655 32740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:47.975370 32740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:47.975741 32740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:47.995167 32740 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:33859
I20260619 06:43:47.995186 338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:33859 every 8 connection(s)
I20260619 06:43:47.996713 32740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:48.000857 339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:48.001786 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 32740
I20260619 06:43:48.001986 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:48.002439 11009 external_mini_cluster.cc:1428] Setting key 00215f21ab003bec399a338a12274f63
I20260619 06:43:48.015640 339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a: Bootstrap starting.
Jun 19 06:43:48 dist-test-slave-7lz4 krb5kdc[32727](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851427, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:43:48.019472 339 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:48.020823 339 log.cc:824] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:48.023927 339 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a: No bootstrap required, opened a new log
I20260619 06:43:48.027148 342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:48.004404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48499 (local address 127.10.192.126:33859)
0619 06:43:48.005205 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:48.005217 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:48.005269 (+ 52us) server_negotiation.cc:407] Connection header received
0619 06:43:48.007046 (+ 1777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:48.007071 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:48.007534 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:48.008034 (+ 500us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:48.009910 (+ 1876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:48.011276 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:48.013227 (+ 1951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:48.013985 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:48.014127 (+ 142us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:48.019189 (+ 5062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:48.019198 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:48.019213 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:48.019260 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:48.022562 (+ 3302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:48.023459 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:48.023466 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:48.023474 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:48.023709 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:48.024253 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:48.024256 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:48.024258 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:48.024804 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:48.025147 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:48.025739 (+ 592us) server_negotiation.cc:299] Negotiation successful
0619 06:43:48.026077 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"thread_start_us":372,"threads_started":1}
I20260619 06:43:48.031771 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:43:48.033639 339 raft_consensus.cc:348] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1b71493210e416a9e71c36a21e53e1a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33859 } }
I20260619 06:43:48.034134 339 raft_consensus.cc:374] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:48.034260 339 raft_consensus.cc:729] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1b71493210e416a9e71c36a21e53e1a, State: Initialized, Role: FOLLOWER
I20260619 06:43:48.035023 339 consensus_queue.cc:260] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1b71493210e416a9e71c36a21e53e1a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33859 } }
I20260619 06:43:48.035362 339 raft_consensus.cc:388] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:48.035535 339 raft_consensus.cc:482] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:48.035784 339 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:48.038829 339 raft_consensus.cc:504] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1b71493210e416a9e71c36a21e53e1a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33859 } }
I20260619 06:43:48.039378 339 leader_election.cc:302] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f1b71493210e416a9e71c36a21e53e1a; no voters:
I20260619 06:43:48.040170 339 leader_election.cc:288] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:48.040282 349 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:48.042972 339 sys_catalog.cc:564] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:48.047384 349 raft_consensus.cc:686] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a [term 1 LEADER]: Becoming Leader. State: Replica: f1b71493210e416a9e71c36a21e53e1a, State: Running, Role: LEADER
I20260619 06:43:48.048316 349 consensus_queue.cc:237] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1b71493210e416a9e71c36a21e53e1a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33859 } }
I20260619 06:43:48.052313 350 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1b71493210e416a9e71c36a21e53e1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1b71493210e416a9e71c36a21e53e1a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33859 } } }
I20260619 06:43:48.052850 350 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:48.053261 342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:48.037108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41121 (local address 127.10.192.126:33859)
0619 06:43:48.037314 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:48.037320 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:48.037841 (+ 521us) server_negotiation.cc:407] Connection header received
0619 06:43:48.037989 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:48.037994 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:48.038071 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:48.038167 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:48.039771 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:48.040938 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:48.042270 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:48.042753 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:48.042905 (+ 152us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:48.045700 (+ 2795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:48.045705 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:48.045709 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:48.045742 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:48.048905 (+ 3163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:48.049822 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:48.049828 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:48.049832 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:48.050025 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:48.050566 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:48.050577 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:48.050584 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:48.051093 (+ 509us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:48.051376 (+ 283us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:48.052675 (+ 1299us) server_negotiation.cc:299] Negotiation successful
0619 06:43:48.052892 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260619 06:43:48.053810 351 sys_catalog.cc:455] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1b71493210e416a9e71c36a21e53e1a. Latest consensus state: current_term: 1 leader_uuid: "f1b71493210e416a9e71c36a21e53e1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1b71493210e416a9e71c36a21e53e1a" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 33859 } } }
I20260619 06:43:48.054217 351 sys_catalog.cc:458] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:48.056766 356 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:48.063097 356 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:48.073918 356 catalog_manager.cc:1347] Generated new cluster ID: ad69e942e4804d6fb7f7251c1fdfd399
I20260619 06:43:48.074059 356 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:48.091476 356 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:48.092998 356 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:48.109076 356 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f1b71493210e416a9e71c36a21e53e1a: Generated new TSK 0
I20260619 06:43:48.110036 356 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:48.120954 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 32740
I20260619 06:43:48.122352 334 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:48.216404 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 32740
W20260619 06:43:48.234273 32725 connection.cc:535] client connection to 127.10.192.126:33859 recv error: Network error: failed to read from TLS socket (remote: 127.10.192.126:33859): Connection reset by peer (error 104)
2026-06-19T06:43:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2044 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:48 dist-test-slave-7lz4 krb5kdc[372](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:48 dist-test-slave-7lz4 krb5kdc[372](info): set up 2 sockets
Jun 19 06:43:48 dist-test-slave-7lz4 krb5kdc[372](info): commencing operation
krb5kdc: starting...
W20260619 06:43:49.332863 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.000s sys 0.030s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:49 dist-test-slave-7lz4 krb5kdc[372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851429, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:43:49.602289 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:37853
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:37167
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:37853
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:49.939769 385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:49.940104 385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:49.940272 385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:49.947683 385 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:49.947849 385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:49.947937 385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:49.948045 385 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:49.948125 385 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:49.958206 385 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:37167
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:37853
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:37853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:49.959614 385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:49.961053 385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:49.973333 393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:49.973344 390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:49.973402 391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:49.974783 385 server_base.cc:1034] running on GCE node
I20260619 06:43:49.975605 385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:49.977211 385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:49.978446 385 hybrid_clock.cc:648] HybridClock initialized: now 1781851429978395 us; error 77 us; skew 500 ppm
I20260619 06:43:49.978814 385 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:49 dist-test-slave-7lz4 krb5kdc[372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851429, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:49.982088 385 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:43:49.983731 385 webserver.cc:460] Webserver started at http://127.10.192.126:35201/ using document root <none> and password file <none>
I20260619 06:43:49.984452 385 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:49.984599 385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:49.984912 385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:49.988117 385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "77af81377b484217b29e5cc24f172def"
format_stamp: "Formatted at 2026-06-19 06:43:49 on dist-test-slave-7lz4"
server_key: "4f0aacaf6e604beed429a9305308739d"
server_key_iv: "8273977fc1499416829a9045e0fd9581"
server_key_version: "encryptionkey@0"
I20260619 06:43:49.988936 385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "77af81377b484217b29e5cc24f172def"
format_stamp: "Formatted at 2026-06-19 06:43:49 on dist-test-slave-7lz4"
server_key: "4f0aacaf6e604beed429a9305308739d"
server_key_iv: "8273977fc1499416829a9045e0fd9581"
server_key_version: "encryptionkey@0"
I20260619 06:43:49.994417 385 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260619 06:43:49.998097 400 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:49.999698 385 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260619 06:43:49.999904 385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "77af81377b484217b29e5cc24f172def"
format_stamp: "Formatted at 2026-06-19 06:43:49 on dist-test-slave-7lz4"
server_key: "4f0aacaf6e604beed429a9305308739d"
server_key_iv: "8273977fc1499416829a9045e0fd9581"
server_key_version: "encryptionkey@0"
I20260619 06:43:50.000118 385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:50.020051 385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:50.024859 385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:50.025171 385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:50.045099 385 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:37853
I20260619 06:43:50.045105 451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:37853 every 8 connection(s)
I20260619 06:43:50.046561 385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:50.049041 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 385
I20260619 06:43:50.049266 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:50.049731 11009 external_mini_cluster.cc:1428] Setting key 65208685444a61c4fe03831a792259b7
I20260619 06:43:50.051784 452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:50.063197 452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def: Bootstrap starting.
I20260619 06:43:50.063901 455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:50.051402 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49643 (local address 127.10.192.126:37853)
0619 06:43:50.052296 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:50.052309 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:50.052355 (+ 46us) server_negotiation.cc:407] Connection header received
0619 06:43:50.054225 (+ 1870us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:50.054249 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:50.054713 (+ 464us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:50.055167 (+ 454us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:50.055798 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:50.057252 (+ 1454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:50.058715 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:50.059444 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:50.059716 (+ 272us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:50.061200 (+ 1484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:50.061209 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:50.061224 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:50.061821 (+ 597us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:50.061907 (+ 86us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:50.061937 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:50.062135 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:50.062456 (+ 321us) server_negotiation.cc:299] Negotiation successful
0619 06:43:50.062654 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":367,"threads_started":1}
I20260619 06:43:50.066684 452 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:50.068277 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:43:50.068315 452 log.cc:824] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:50.071319 452 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def: No bootstrap required, opened a new log
I20260619 06:43:50.079937 455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:50.072857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42249 (local address 127.10.192.126:37853)
0619 06:43:50.073073 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:50.073084 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:50.073472 (+ 388us) server_negotiation.cc:407] Connection header received
0619 06:43:50.073630 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:50.073637 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:50.073732 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:50.073845 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:50.074329 (+ 484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:50.075523 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:50.076912 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:50.077674 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:50.077824 (+ 150us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:50.078937 (+ 1113us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:50.078949 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:50.078955 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:50.078979 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:50.079059 (+ 80us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:50.079083 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:50.079209 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:50.079463 (+ 254us) server_negotiation.cc:299] Negotiation successful
0619 06:43:50.079531 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 06:43:50.081269 452 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77af81377b484217b29e5cc24f172def" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37853 } }
I20260619 06:43:50.081729 452 raft_consensus.cc:374] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:50.081843 452 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77af81377b484217b29e5cc24f172def, State: Initialized, Role: FOLLOWER
I20260619 06:43:50.082391 452 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77af81377b484217b29e5cc24f172def" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37853 } }
I20260619 06:43:50.082604 452 raft_consensus.cc:388] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:50.082760 452 raft_consensus.cc:482] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:50.082962 452 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:50.085578 452 raft_consensus.cc:504] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77af81377b484217b29e5cc24f172def" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37853 } }
I20260619 06:43:50.086155 452 leader_election.cc:302] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77af81377b484217b29e5cc24f172def; no voters:
I20260619 06:43:50.086869 452 leader_election.cc:288] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:50.087046 462 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:50.087910 462 raft_consensus.cc:686] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def [term 1 LEADER]: Becoming Leader. State: Replica: 77af81377b484217b29e5cc24f172def, State: Running, Role: LEADER
I20260619 06:43:50.088531 462 consensus_queue.cc:237] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77af81377b484217b29e5cc24f172def" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37853 } }
I20260619 06:43:50.089468 452 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:50.091529 463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77af81377b484217b29e5cc24f172def" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77af81377b484217b29e5cc24f172def" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37853 } } }
I20260619 06:43:50.092072 463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:50.093211 464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77af81377b484217b29e5cc24f172def. Latest consensus state: current_term: 1 leader_uuid: "77af81377b484217b29e5cc24f172def" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77af81377b484217b29e5cc24f172def" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 37853 } } }
I20260619 06:43:50.094288 464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:50.093979 470 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:50.100282 470 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:50.110702 470 catalog_manager.cc:1347] Generated new cluster ID: 5903e01e7d634b10a2363fdf63b7639c
I20260619 06:43:50.110859 470 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:50.126767 470 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:50.128214 470 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:50.136044 470 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 77af81377b484217b29e5cc24f172def: Generated new TSK 0
I20260619 06:43:50.136956 470 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:50.146590 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 385
W20260619 06:43:50.147871 447 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:49643
W20260619 06:43:50.148633 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 385: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:43:50.148794 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 385
W20260619 06:43:50.166050 370 connection.cc:535] client connection to 127.10.192.126:37853 recv error: Network error: failed to read from TLS socket (remote: 127.10.192.126:37853): Connection reset by peer (error 104)
2026-06-19T06:43:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1931 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:50 dist-test-slave-7lz4 krb5kdc[483](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:50 dist-test-slave-7lz4 krb5kdc[483](info): set up 2 sockets
Jun 19 06:43:50 dist-test-slave-7lz4 krb5kdc[483](info): commencing operation
krb5kdc: starting...
W20260619 06:43:51.264178 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.078s user 0.004s sys 0.025s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:51 dist-test-slave-7lz4 krb5kdc[483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851431, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:43:51.529311 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:41071
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:39447
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:41071
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:51.877808 496 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:51.878137 496 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:51.878306 496 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:51.885818 496 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:51.885953 496 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:51.886054 496 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:51.886137 496 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:51.886215 496 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:51.896425 496 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:39447
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:41071
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:41071
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:51.897873 496 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:51.899296 496 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:51.912444 501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:51.912377 504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:51.912448 502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:51.912858 496 server_base.cc:1034] running on GCE node
I20260619 06:43:51.913882 496 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:51.915426 496 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:51.916669 496 hybrid_clock.cc:648] HybridClock initialized: now 1781851431916608 us; error 82 us; skew 500 ppm
I20260619 06:43:51.917099 496 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:51 dist-test-slave-7lz4 krb5kdc[483](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851431, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:51.920405 496 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:43:51.921950 496 webserver.cc:460] Webserver started at http://127.10.192.126:37489/ using document root <none> and password file <none>
I20260619 06:43:51.922700 496 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:51.922852 496 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:51.923439 496 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:51.926726 496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "bb732a87d097495b84e244f85d8a8e2d"
format_stamp: "Formatted at 2026-06-19 06:43:51 on dist-test-slave-7lz4"
server_key: "5b0af79b0f3a9bf0dfea40b299baadba"
server_key_iv: "517bd3a3014bdb318c28027bfa3e8a8a"
server_key_version: "encryptionkey@0"
I20260619 06:43:51.927557 496 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "bb732a87d097495b84e244f85d8a8e2d"
format_stamp: "Formatted at 2026-06-19 06:43:51 on dist-test-slave-7lz4"
server_key: "5b0af79b0f3a9bf0dfea40b299baadba"
server_key_iv: "517bd3a3014bdb318c28027bfa3e8a8a"
server_key_version: "encryptionkey@0"
I20260619 06:43:51.933116 496 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260619 06:43:51.936810 511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:51.938166 496 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260619 06:43:51.938365 496 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "bb732a87d097495b84e244f85d8a8e2d"
format_stamp: "Formatted at 2026-06-19 06:43:51 on dist-test-slave-7lz4"
server_key: "5b0af79b0f3a9bf0dfea40b299baadba"
server_key_iv: "517bd3a3014bdb318c28027bfa3e8a8a"
server_key_version: "encryptionkey@0"
I20260619 06:43:51.938575 496 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:51.944514 496 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:51.948760 496 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:51.949074 496 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:51.968217 496 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:41071
I20260619 06:43:51.968261 562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:41071 every 8 connection(s)
I20260619 06:43:51.969676 496 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:51.973690 563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:51.975757 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 496
I20260619 06:43:51.975939 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:51.976373 11009 external_mini_cluster.cc:1428] Setting key 7120ddb12510b1daf5c06a98b3908790
I20260619 06:43:51.985023 566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:51.978323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34731 (local address 127.10.192.126:41071)
0619 06:43:51.979141 (+ 818us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:51.979157 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:51.979228 (+ 71us) server_negotiation.cc:407] Connection header received
0619 06:43:51.981019 (+ 1791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:51.981049 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:51.981548 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:51.981985 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:51.982946 (+ 961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:51.982956 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:51.982973 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:51.982992 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:51.983064 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:51.983098 (+ 34us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:51.983339 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:51.983476 (+ 137us) server_negotiation.cc:299] Negotiation successful
0619 06:43:51.983700 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":339,"threads_started":1}
I20260619 06:43:51.988909 563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d: Bootstrap starting.
I20260619 06:43:51.989513 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:43:51.992136 563 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:51.993594 563 log.cc:824] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:51.996975 566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:51.994247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59145 (local address 127.10.192.126:41071)
0619 06:43:51.994435 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:51.994442 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:51.994711 (+ 269us) server_negotiation.cc:407] Connection header received
0619 06:43:51.994852 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:51.994860 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:51.994926 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:51.995034 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:51.996166 (+ 1132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:51.996173 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:51.996177 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:51.996194 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:51.996239 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:51.996257 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:51.996366 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:51.996504 (+ 138us) server_negotiation.cc:299] Negotiation successful
0619 06:43:51.996555 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260619 06:43:51.997249 563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d: No bootstrap required, opened a new log
I20260619 06:43:52.004796 563 raft_consensus.cc:348] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb732a87d097495b84e244f85d8a8e2d" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 41071 } }
I20260619 06:43:52.005239 563 raft_consensus.cc:374] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:52.005358 563 raft_consensus.cc:729] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb732a87d097495b84e244f85d8a8e2d, State: Initialized, Role: FOLLOWER
I20260619 06:43:52.005960 563 consensus_queue.cc:260] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb732a87d097495b84e244f85d8a8e2d" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 41071 } }
I20260619 06:43:52.006220 563 raft_consensus.cc:388] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:52.006376 563 raft_consensus.cc:482] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:52.006552 563 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:52.009020 563 raft_consensus.cc:504] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb732a87d097495b84e244f85d8a8e2d" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 41071 } }
I20260619 06:43:52.009558 563 leader_election.cc:302] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bb732a87d097495b84e244f85d8a8e2d; no voters:
I20260619 06:43:52.010170 563 leader_election.cc:288] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:52.010383 573 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:52.011121 573 raft_consensus.cc:686] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d [term 1 LEADER]: Becoming Leader. State: Replica: bb732a87d097495b84e244f85d8a8e2d, State: Running, Role: LEADER
I20260619 06:43:52.011782 573 consensus_queue.cc:237] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb732a87d097495b84e244f85d8a8e2d" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 41071 } }
I20260619 06:43:52.012428 563 sys_catalog.cc:564] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:52.014870 574 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bb732a87d097495b84e244f85d8a8e2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb732a87d097495b84e244f85d8a8e2d" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 41071 } } }
I20260619 06:43:52.016042 574 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:52.015142 575 sys_catalog.cc:455] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader bb732a87d097495b84e244f85d8a8e2d. Latest consensus state: current_term: 1 leader_uuid: "bb732a87d097495b84e244f85d8a8e2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bb732a87d097495b84e244f85d8a8e2d" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 41071 } } }
I20260619 06:43:52.016671 575 sys_catalog.cc:458] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:52.018117 582 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:52.023973 582 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:52.034516 582 catalog_manager.cc:1347] Generated new cluster ID: 366acb3e4f064fcab385038851656096
I20260619 06:43:52.034775 582 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:52.051919 582 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:52.052409 582 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:52.071451 582 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bb732a87d097495b84e244f85d8a8e2d: Generated new TSK 0
I20260619 06:43:52.072779 582 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:52.088980 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 496
W20260619 06:43:52.090634 558 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:34731
W20260619 06:43:52.091506 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 496: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:43:52.091681 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 496
2026-06-19T06:43:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1942 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:52 dist-test-slave-7lz4 krb5kdc[594](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:52 dist-test-slave-7lz4 krb5kdc[594](info): set up 2 sockets
Jun 19 06:43:52 dist-test-slave-7lz4 krb5kdc[594](info): commencing operation
krb5kdc: starting...
W20260619 06:43:53.209806 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.081s user 0.001s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:53 dist-test-slave-7lz4 krb5kdc[594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851433, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:43:53.470580 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:34769
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:46387
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:34769
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:53.803361 607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:53.803697 607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:53.803915 607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:53.811689 607 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:53.811895 607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:53.812032 607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:53.812139 607 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:53.812214 607 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:53.823107 607 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:46387
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:34769
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:34769
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:53.824506 607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:53.825874 607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:53.838435 613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:53.838423 615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:53.838541 612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:53.839079 607 server_base.cc:1034] running on GCE node
I20260619 06:43:53.839996 607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:53.841567 607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:53.842784 607 hybrid_clock.cc:648] HybridClock initialized: now 1781851433842701 us; error 65 us; skew 500 ppm
I20260619 06:43:53.843161 607 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:53 dist-test-slave-7lz4 krb5kdc[594](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851433, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:53.846469 607 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:43:53.848054 607 webserver.cc:460] Webserver started at http://127.10.192.126:46125/ using document root <none> and password file <none>
I20260619 06:43:53.848729 607 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:53.848835 607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:53.849086 607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:53.852169 607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "23577e8bfeeb40e1a16b818f3410d27b"
format_stamp: "Formatted at 2026-06-19 06:43:53 on dist-test-slave-7lz4"
server_key: "79b53e76190f6e9c692f6de8c9373bab"
server_key_iv: "1808a1e372e396df8dcfeffff0a58c46"
server_key_version: "encryptionkey@0"
I20260619 06:43:53.852887 607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "23577e8bfeeb40e1a16b818f3410d27b"
format_stamp: "Formatted at 2026-06-19 06:43:53 on dist-test-slave-7lz4"
server_key: "79b53e76190f6e9c692f6de8c9373bab"
server_key_iv: "1808a1e372e396df8dcfeffff0a58c46"
server_key_version: "encryptionkey@0"
I20260619 06:43:53.858256 607 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260619 06:43:53.861900 622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:53.863457 607 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260619 06:43:53.863709 607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "23577e8bfeeb40e1a16b818f3410d27b"
format_stamp: "Formatted at 2026-06-19 06:43:53 on dist-test-slave-7lz4"
server_key: "79b53e76190f6e9c692f6de8c9373bab"
server_key_iv: "1808a1e372e396df8dcfeffff0a58c46"
server_key_version: "encryptionkey@0"
I20260619 06:43:53.863909 607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:53.878921 607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:53.883669 607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:53.884053 607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:53.902549 607 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:34769
I20260619 06:43:53.902580 673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:34769 every 8 connection(s)
I20260619 06:43:53.904099 607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:53.905763 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 607
I20260619 06:43:53.905968 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:53.906409 11009 external_mini_cluster.cc:1428] Setting key 539f145c332544b6430547c2e31d1181
I20260619 06:43:53.908674 674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Jun 19 06:43:53 dist-test-slave-7lz4 krb5kdc[594](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851433, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:43:53.922132 674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b: Bootstrap starting.
I20260619 06:43:53.925798 674 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:53.927042 674 log.cc:824] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:53.930204 674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b: No bootstrap required, opened a new log
I20260619 06:43:53.931121 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:53.908229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52173 (local address 127.10.192.126:34769)
0619 06:43:53.909021 (+ 792us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:53.909038 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:53.909090 (+ 52us) server_negotiation.cc:407] Connection header received
0619 06:43:53.911520 (+ 2430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:53.911549 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:53.912116 (+ 567us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:53.912595 (+ 479us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:53.913940 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:53.916042 (+ 2102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:53.917285 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:53.918350 (+ 1065us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:53.918546 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:53.923012 (+ 4466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:53.923021 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:53.923036 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:53.923079 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:53.926556 (+ 3477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:53.927453 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:53.927460 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:53.927466 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:53.927761 (+ 295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:53.928268 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:53.928280 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:53.928285 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:53.928819 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:53.929130 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:53.929608 (+ 478us) server_negotiation.cc:299] Negotiation successful
0619 06:43:53.930054 (+ 446us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":327,"threads_started":1}
I20260619 06:43:53.935312 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:43:53.938990 674 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23577e8bfeeb40e1a16b818f3410d27b" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34769 } }
I20260619 06:43:53.939400 674 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:53.939527 674 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23577e8bfeeb40e1a16b818f3410d27b, State: Initialized, Role: FOLLOWER
I20260619 06:43:53.940224 674 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23577e8bfeeb40e1a16b818f3410d27b" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34769 } }
I20260619 06:43:53.940474 674 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:53.940609 674 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:53.940809 674 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:53.944012 674 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23577e8bfeeb40e1a16b818f3410d27b" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34769 } }
I20260619 06:43:53.944662 674 leader_election.cc:302] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23577e8bfeeb40e1a16b818f3410d27b; no voters:
I20260619 06:43:53.945322 674 leader_election.cc:288] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:53.945451 684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:53.946905 684 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b [term 1 LEADER]: Becoming Leader. State: Replica: 23577e8bfeeb40e1a16b818f3410d27b, State: Running, Role: LEADER
I20260619 06:43:53.947592 684 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23577e8bfeeb40e1a16b818f3410d27b" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34769 } }
I20260619 06:43:53.947793 674 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:53.950344 686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23577e8bfeeb40e1a16b818f3410d27b. Latest consensus state: current_term: 1 leader_uuid: "23577e8bfeeb40e1a16b818f3410d27b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23577e8bfeeb40e1a16b818f3410d27b" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34769 } } }
I20260619 06:43:53.950737 686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:53.951539 685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23577e8bfeeb40e1a16b818f3410d27b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23577e8bfeeb40e1a16b818f3410d27b" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34769 } } }
I20260619 06:43:53.951859 685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:53.954491 692 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:53.960237 677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:53.939749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45087 (local address 127.10.192.126:34769)
0619 06:43:53.939976 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:53.939985 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:53.940603 (+ 618us) server_negotiation.cc:407] Connection header received
0619 06:43:53.940823 (+ 220us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:53.940830 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:53.940921 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:53.941034 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:53.943024 (+ 1990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:53.943910 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:53.945745 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:53.946406 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:53.946502 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:53.949971 (+ 3469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:53.949981 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:53.949992 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:53.950044 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:53.954867 (+ 4823us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:53.956018 (+ 1151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:53.956027 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:53.956037 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:53.956373 (+ 336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:53.956915 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:53.956924 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:53.956933 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:53.957494 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:53.957879 (+ 385us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:53.959322 (+ 1443us) server_negotiation.cc:299] Negotiation successful
0619 06:43:53.959683 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260619 06:43:53.960364 692 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:53.970753 692 catalog_manager.cc:1347] Generated new cluster ID: 2db684011e0842689dab001a677603b6
I20260619 06:43:53.970901 692 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:54.009249 692 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:54.010870 692 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:54.018126 692 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23577e8bfeeb40e1a16b818f3410d27b: Generated new TSK 0
I20260619 06:43:54.019272 692 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:54.033332 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 607
I20260619 06:43:54.034513 669 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:43:54.133210 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 607
2026-06-19T06:43:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2040 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:54 dist-test-slave-7lz4 krb5kdc[706](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:54 dist-test-slave-7lz4 krb5kdc[706](info): set up 2 sockets
Jun 19 06:43:54 dist-test-slave-7lz4 krb5kdc[706](info): commencing operation
krb5kdc: starting...
W20260619 06:43:55.248272 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.000s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:55 dist-test-slave-7lz4 krb5kdc[706](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:43:55.509027 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:43681
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:43661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:43681
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:55.843119 719 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:55.843405 719 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:55.843502 719 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:55.850890 719 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:55.851009 719 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:55.851068 719 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:55.851127 719 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:55.851169 719 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:55.861261 719 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:43661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:43681
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:43681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:55.862571 719 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:55.863930 719 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:55.875955 727 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:55.876051 724 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:55.876026 725 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:55.877017 719 server_base.cc:1034] running on GCE node
I20260619 06:43:55.877796 719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:55.879271 719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:55.880504 719 hybrid_clock.cc:648] HybridClock initialized: now 1781851435880473 us; error 54 us; skew 500 ppm
I20260619 06:43:55.880873 719 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:55 dist-test-slave-7lz4 krb5kdc[706](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851435, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:55.884258 719 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:43:55.886027 719 webserver.cc:460] Webserver started at http://127.10.192.126:45095/ using document root <none> and password file <none>
I20260619 06:43:55.886794 719 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:55.886962 719 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:55.887286 719 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:55.890592 719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "29c7fef855b749c6a9d72b4fb448d7dc"
format_stamp: "Formatted at 2026-06-19 06:43:55 on dist-test-slave-7lz4"
server_key: "61733ea1ec78be8318f1a32edfb657ab"
server_key_iv: "a58f9f3eb383a264591cd675d8e6a30f"
server_key_version: "encryptionkey@0"
I20260619 06:43:55.891463 719 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "29c7fef855b749c6a9d72b4fb448d7dc"
format_stamp: "Formatted at 2026-06-19 06:43:55 on dist-test-slave-7lz4"
server_key: "61733ea1ec78be8318f1a32edfb657ab"
server_key_iv: "a58f9f3eb383a264591cd675d8e6a30f"
server_key_version: "encryptionkey@0"
I20260619 06:43:55.897176 719 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260619 06:43:55.901010 734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:55.902451 719 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.004s
I20260619 06:43:55.902655 719 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "29c7fef855b749c6a9d72b4fb448d7dc"
format_stamp: "Formatted at 2026-06-19 06:43:55 on dist-test-slave-7lz4"
server_key: "61733ea1ec78be8318f1a32edfb657ab"
server_key_iv: "a58f9f3eb383a264591cd675d8e6a30f"
server_key_version: "encryptionkey@0"
I20260619 06:43:55.902882 719 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:55.986670 719 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:55.990947 719 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:55.991292 719 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:56.010501 719 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:43681
I20260619 06:43:56.010531 785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:43681 every 8 connection(s)
I20260619 06:43:56.011986 719 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:56.015949 786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:56.016085 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 719
I20260619 06:43:56.016254 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:56.016815 11009 external_mini_cluster.cc:1428] Setting key 4b59148bc65294a932db8904f59c7d81
I20260619 06:43:56.030334 789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:56.018684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38345 (local address 127.10.192.126:43681)
0619 06:43:56.019671 (+ 987us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:56.019690 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:56.019744 (+ 54us) server_negotiation.cc:407] Connection header received
0619 06:43:56.021296 (+ 1552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:56.021319 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:56.021747 (+ 428us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:56.022100 (+ 353us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:56.022686 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:56.024092 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:56.025920 (+ 1828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:56.026582 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:56.026709 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:56.028013 (+ 1304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:56.028020 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:56.028034 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:56.028597 (+ 563us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:56.028676 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:56.028701 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:56.028790 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:56.029017 (+ 227us) server_negotiation.cc:299] Negotiation successful
0619 06:43:56.029311 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":725,"thread_start_us":493,"threads_started":1}
I20260619 06:43:56.030344 786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc: Bootstrap starting.
I20260619 06:43:56.033867 786 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:56.034332 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:43:56.035022 786 log.cc:824] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:56.037976 786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc: No bootstrap required, opened a new log
I20260619 06:43:56.045181 789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:56.038705 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34789 (local address 127.10.192.126:43681)
0619 06:43:56.038858 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:56.038863 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:56.039377 (+ 514us) server_negotiation.cc:407] Connection header received
0619 06:43:56.039601 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:56.039605 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:56.039722 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:56.039838 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:56.040479 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:56.041226 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:56.042552 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:56.043066 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:56.043226 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:56.044430 (+ 1204us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:56.044437 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:56.044440 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:56.044461 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:56.044499 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:56.044514 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:56.044629 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:56.044763 (+ 134us) server_negotiation.cc:299] Negotiation successful
0619 06:43:56.044854 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260619 06:43:56.047320 786 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29c7fef855b749c6a9d72b4fb448d7dc" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43681 } }
I20260619 06:43:56.047796 786 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:56.047904 786 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c7fef855b749c6a9d72b4fb448d7dc, State: Initialized, Role: FOLLOWER
I20260619 06:43:56.048624 786 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29c7fef855b749c6a9d72b4fb448d7dc" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43681 } }
I20260619 06:43:56.048942 786 raft_consensus.cc:388] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:56.049089 786 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:56.049243 786 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:56.051434 786 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29c7fef855b749c6a9d72b4fb448d7dc" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43681 } }
I20260619 06:43:56.051981 786 leader_election.cc:302] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29c7fef855b749c6a9d72b4fb448d7dc; no voters:
I20260619 06:43:56.052585 786 leader_election.cc:288] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:56.052739 796 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:56.053433 796 raft_consensus.cc:686] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc [term 1 LEADER]: Becoming Leader. State: Replica: 29c7fef855b749c6a9d72b4fb448d7dc, State: Running, Role: LEADER
I20260619 06:43:56.054030 796 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29c7fef855b749c6a9d72b4fb448d7dc" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43681 } }
I20260619 06:43:56.054863 786 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:56.057086 797 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "29c7fef855b749c6a9d72b4fb448d7dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29c7fef855b749c6a9d72b4fb448d7dc" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43681 } } }
I20260619 06:43:56.057072 798 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29c7fef855b749c6a9d72b4fb448d7dc. Latest consensus state: current_term: 1 leader_uuid: "29c7fef855b749c6a9d72b4fb448d7dc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29c7fef855b749c6a9d72b4fb448d7dc" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 43681 } } }
I20260619 06:43:56.057551 797 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:56.057551 798 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:56.059109 801 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:56.066895 801 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:56.076805 801 catalog_manager.cc:1347] Generated new cluster ID: b6c33b3c996f448f944f510a4ca68820
I20260619 06:43:56.076939 801 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:56.100301 801 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:56.102294 801 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:56.113273 801 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 29c7fef855b749c6a9d72b4fb448d7dc: Generated new TSK 0
I20260619 06:43:56.114364 801 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:56.127174 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 719
W20260619 06:43:56.128355 781 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:38345
W20260619 06:43:56.129057 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 719: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:43:56.129215 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 719
2026-06-19T06:43:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1995 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:56 dist-test-slave-7lz4 krb5kdc[817](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:56 dist-test-slave-7lz4 krb5kdc[817](info): set up 2 sockets
Jun 19 06:43:56 dist-test-slave-7lz4 krb5kdc[817](info): commencing operation
krb5kdc: starting...
W20260619 06:43:57.244170 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.079s user 0.003s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:57 dist-test-slave-7lz4 krb5kdc[817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851437, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:43:57.514324 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:46435
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:46353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:46435
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:57.856017 830 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:57.856334 830 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:57.856528 830 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:57.864039 830 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:57.864192 830 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:57.864284 830 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:57.864396 830 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:57.864485 830 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:57.874678 830 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:46353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:46435
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:46435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:57.876140 830 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:57.877564 830 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:57.889938 838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:57.889902 835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:57.889880 836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:57.891259 830 server_base.cc:1034] running on GCE node
I20260619 06:43:57.892150 830 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:57.893700 830 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:57.894971 830 hybrid_clock.cc:648] HybridClock initialized: now 1781851437894908 us; error 57 us; skew 500 ppm
I20260619 06:43:57.895377 830 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:57 dist-test-slave-7lz4 krb5kdc[817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851437, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:57.903398 830 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:43:57.905170 830 webserver.cc:460] Webserver started at http://127.10.192.126:34795/ using document root <none> and password file <none>
I20260619 06:43:57.905925 830 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:57.906078 830 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:57.906399 830 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:57.909603 830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "23c2540e3e284a698c2f62ff579865cb"
format_stamp: "Formatted at 2026-06-19 06:43:57 on dist-test-slave-7lz4"
server_key: "619902dc7dad75889c4808ef560714ee"
server_key_iv: "e9756f57a4752cdbf4d1e8066b6b61e8"
server_key_version: "encryptionkey@0"
I20260619 06:43:57.910493 830 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "23c2540e3e284a698c2f62ff579865cb"
format_stamp: "Formatted at 2026-06-19 06:43:57 on dist-test-slave-7lz4"
server_key: "619902dc7dad75889c4808ef560714ee"
server_key_iv: "e9756f57a4752cdbf4d1e8066b6b61e8"
server_key_version: "encryptionkey@0"
I20260619 06:43:57.915930 830 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260619 06:43:57.919497 845 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:57.920992 830 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:43:57.921183 830 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "23c2540e3e284a698c2f62ff579865cb"
format_stamp: "Formatted at 2026-06-19 06:43:57 on dist-test-slave-7lz4"
server_key: "619902dc7dad75889c4808ef560714ee"
server_key_iv: "e9756f57a4752cdbf4d1e8066b6b61e8"
server_key_version: "encryptionkey@0"
I20260619 06:43:57.921409 830 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:57.927156 830 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:57.931345 830 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:57.931696 830 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:57.950466 830 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:46435
I20260619 06:43:57.950501 896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:46435 every 8 connection(s)
I20260619 06:43:57.952111 830 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:57.956065 897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:57.961400 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 830
I20260619 06:43:57.961608 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:57.962091 11009 external_mini_cluster.cc:1428] Setting key 4bb328f657875fa2b66222c57c2d3ec4
I20260619 06:43:57.966928 897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb: Bootstrap starting.
I20260619 06:43:57.970059 900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:57.963995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51563 (local address 127.10.192.126:46435)
0619 06:43:57.964887 (+ 892us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:57.964900 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:57.964946 (+ 46us) server_negotiation.cc:407] Connection header received
0619 06:43:57.966622 (+ 1676us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:57.966645 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:57.966998 (+ 353us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:57.967397 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:57.968492 (+ 1095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:57.968498 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:57.968512 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:57.968526 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:57.968591 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:57.968614 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:57.968790 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:57.968896 (+ 106us) server_negotiation.cc:299] Negotiation successful
0619 06:43:57.969104 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":645,"thread_start_us":397,"threads_started":1}
I20260619 06:43:57.970790 897 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb: Neither blocks nor log segments found. Creating new log.
I20260619 06:43:57.972033 897 log.cc:824] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb: Log is configured to *not* fsync() on all Append() calls
I20260619 06:43:57.974299 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:43:57.975469 897 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb: No bootstrap required, opened a new log
I20260619 06:43:57.982430 900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:57.979803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49819 (local address 127.10.192.126:46435)
0619 06:43:57.979998 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:57.980005 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:57.980439 (+ 434us) server_negotiation.cc:407] Connection header received
0619 06:43:57.980583 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:57.980589 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:57.980655 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:57.980771 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:57.981767 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:57.981774 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:57.981779 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0619 06:43:57.981799 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:57.981853 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0619 06:43:57.981880 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:57.982011 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:57.982056 (+ 45us) server_negotiation.cc:299] Negotiation successful
0619 06:43:57.982116 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 06:43:57.985194 897 raft_consensus.cc:348] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23c2540e3e284a698c2f62ff579865cb" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 46435 } }
I20260619 06:43:57.985602 897 raft_consensus.cc:374] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260619 06:43:57.985731 897 raft_consensus.cc:729] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23c2540e3e284a698c2f62ff579865cb, State: Initialized, Role: FOLLOWER
I20260619 06:43:57.986334 897 consensus_queue.cc:260] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23c2540e3e284a698c2f62ff579865cb" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 46435 } }
I20260619 06:43:57.986577 897 raft_consensus.cc:388] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260619 06:43:57.986740 897 raft_consensus.cc:482] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260619 06:43:57.986927 897 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:43:57.989370 897 raft_consensus.cc:504] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23c2540e3e284a698c2f62ff579865cb" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 46435 } }
I20260619 06:43:57.989912 897 leader_election.cc:302] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 23c2540e3e284a698c2f62ff579865cb; no voters:
I20260619 06:43:57.990684 897 leader_election.cc:288] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260619 06:43:57.990823 907 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:43:57.991598 907 raft_consensus.cc:686] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb [term 1 LEADER]: Becoming Leader. State: Replica: 23c2540e3e284a698c2f62ff579865cb, State: Running, Role: LEADER
I20260619 06:43:57.992470 907 consensus_queue.cc:237] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23c2540e3e284a698c2f62ff579865cb" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 46435 } }
I20260619 06:43:57.993172 897 sys_catalog.cc:564] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:43:57.995368 909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 23c2540e3e284a698c2f62ff579865cb. Latest consensus state: current_term: 1 leader_uuid: "23c2540e3e284a698c2f62ff579865cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23c2540e3e284a698c2f62ff579865cb" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 46435 } } }
I20260619 06:43:57.995841 909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:57.997794 908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "23c2540e3e284a698c2f62ff579865cb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "23c2540e3e284a698c2f62ff579865cb" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 46435 } } }
I20260619 06:43:57.998162 908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb [sys.catalog]: This master's current role is: LEADER
I20260619 06:43:58.000038 915 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:43:58.005453 915 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:43:58.015877 915 catalog_manager.cc:1347] Generated new cluster ID: 3815142890f24eeabce7f7bd09fda925
I20260619 06:43:58.016067 915 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:43:58.045933 915 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:43:58.046481 915 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:43:58.062925 915 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 23c2540e3e284a698c2f62ff579865cb: Generated new TSK 0
I20260619 06:43:58.064136 915 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:43:58.077193 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 830
W20260619 06:43:58.078657 892 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:51563
W20260619 06:43:58.079416 11009 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 830: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260619 06:43:58.079552 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 830
2026-06-19T06:43:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1950 ms)
[----------] 18 tests from AuthTokenIssuingTest (35629 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:43:58 dist-test-slave-7lz4 krb5kdc[928](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:43:58 dist-test-slave-7lz4 krb5kdc[928](info): set up 2 sockets
Jun 19 06:43:58 dist-test-slave-7lz4 krb5kdc[928](info): commencing operation
krb5kdc: starting...
W20260619 06:43:59.192353 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.076s user 0.004s sys 0.026s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:43:59 dist-test-slave-7lz4 krb5kdc[928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:43:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:43:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:43:59.463150 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:34563
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:43333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:34563,127.10.192.125:39653,127.10.192.124:41673
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:43:59.801000 941 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260619 06:43:59.801424 941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:43:59.801568 941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:43:59.801729 941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:43:59.809304 941 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:43:59.809414 941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:43:59.809523 941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:43:59.809610 941 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:43:59.809726 941 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:43:59.819994 941 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:43333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:34563,127.10.192.125:39653,127.10.192.124:41673
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:34563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:43:59.821400 941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:43:59.822774 941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:43:59.836302 947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:59.836692 946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:43:59.838618 949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:43:59.839565 941 server_base.cc:1034] running on GCE node
I20260619 06:43:59.840785 941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:43:59.842262 941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:43:59.843497 941 hybrid_clock.cc:648] HybridClock initialized: now 1781851439843441 us; error 28 us; skew 500 ppm
I20260619 06:43:59.843911 941 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:43:59 dist-test-slave-7lz4 krb5kdc[928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851439, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:43:59.847100 941 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:43:59.848841 941 webserver.cc:460] Webserver started at http://127.10.192.126:32973/ using document root <none> and password file <none>
I20260619 06:43:59.849619 941 fs_manager.cc:359] Metadata directory not provided
I20260619 06:43:59.849758 941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:43:59.850107 941 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:43:59.853315 941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "557ded928f204f64aa4f39084e782a35"
format_stamp: "Formatted at 2026-06-19 06:43:59 on dist-test-slave-7lz4"
server_key: "d8c43c5e905647ae183d271cd9d10b91"
server_key_iv: "540dfe599a7bd7942d158cd2bd941a65"
server_key_version: "encryptionkey@0"
I20260619 06:43:59.854171 941 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "557ded928f204f64aa4f39084e782a35"
format_stamp: "Formatted at 2026-06-19 06:43:59 on dist-test-slave-7lz4"
server_key: "d8c43c5e905647ae183d271cd9d10b91"
server_key_iv: "540dfe599a7bd7942d158cd2bd941a65"
server_key_version: "encryptionkey@0"
I20260619 06:43:59.859822 941 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.003s
I20260619 06:43:59.863432 956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:43:59.864969 941 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:43:59.865171 941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "557ded928f204f64aa4f39084e782a35"
format_stamp: "Formatted at 2026-06-19 06:43:59 on dist-test-slave-7lz4"
server_key: "d8c43c5e905647ae183d271cd9d10b91"
server_key_iv: "540dfe599a7bd7942d158cd2bd941a65"
server_key_version: "encryptionkey@0"
I20260619 06:43:59.865404 941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:43:59.882544 941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:43:59.886981 941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:43:59.887267 941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:43:59.906826 941 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:34563
I20260619 06:43:59.906876 1007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:34563 every 8 connection(s)
I20260619 06:43:59.908318 941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:43:59.909705 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 941
I20260619 06:43:59.909943 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:43:59.910817 11009 external_mini_cluster.cc:1428] Setting key f2ee1674ba7c6d8432170d36f3fb21bb
I20260619 06:43:59.913378 1008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:43:59.923579 1008 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.10.192.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.125@KRBTEST.COM" created.
Jun 19 06:43:59 dist-test-slave-7lz4 krb5kdc[928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851439, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:43:59.948835 1012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:59.927287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56198 (local address 127.10.192.126:34563)
0619 06:43:59.929180 (+ 1893us) server_negotiation.cc:206] Beginning negotiation
0619 06:43:59.929189 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:43:59.929246 (+ 57us) server_negotiation.cc:407] Connection header received
0619 06:43:59.930947 (+ 1701us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:43:59.930953 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:43:59.931223 (+ 270us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:43:59.931457 (+ 234us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:43:59.932902 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:59.934211 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:59.936030 (+ 1819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:43:59.936627 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:43:59.936848 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:59.941209 (+ 4361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:43:59.941218 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:43:59.941230 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:43:59.941264 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:43:59.944233 (+ 2969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:59.944945 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:59.944952 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:59.944954 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:59.945098 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:43:59.945492 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:43:59.945497 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:43:59.945502 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:43:59.946023 (+ 521us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:43:59.946247 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0619 06:43:59.946820 (+ 573us) server_negotiation.cc:299] Negotiation successful
0619 06:43:59.947173 (+ 353us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1637,"spinlock_wait_cycles":18304,"thread_start_us":1404,"threads_started":1}
I20260619 06:43:59.948869 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:59.927286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:34563 (local address 127.0.0.1:56198)
0619 06:43:59.928272 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:59.928328 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 06:43:59.930509 (+ 2181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:43:59.931467 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:43:59.931475 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:43:59.932294 (+ 819us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:43:59.932662 (+ 368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:59.932681 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:59.934391 (+ 1710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:59.934399 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:59.935882 (+ 1483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:43:59.935896 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:43:59.936883 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:43:59.936891 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:43:59.937091 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:43:59.937886 (+ 795us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:43:59.937912 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:43:59.940963 (+ 3051us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:43:59.944370 (+ 3407us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:59.944383 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:59.944397 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:59.944802 (+ 405us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:59.945215 (+ 413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:43:59.945219 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:43:59.945223 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:43:59.945380 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:43:59.946190 (+ 810us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:43:59.946197 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:43:59.946412 (+ 215us) client_negotiation.cc:769] Sending connection context
0619 06:43:59.946680 (+ 268us) client_negotiation.cc:240] Negotiation successful
0619 06:43:59.947305 (+ 625us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"mutex_wait_us":141,"thread_start_us":433,"threads_started":1}
I20260619 06:43:59.952270 1008 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } has no permanent_uuid. Determining permanent_uuid...
I20260619 06:43:59.953562 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:59.953125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:39653 (local address 127.0.0.1:48600)
0619 06:43:59.953327 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:59.953441 (+ 114us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:39653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
W20260619 06:43:59.953897 960 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.192.125:39653: connect: Connection refused (error 111)
I20260619 06:43:59.955536 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:43:59.955163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:39653 (local address 127.0.0.1:48602)
0619 06:43:59.955329 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0619 06:43:59.955397 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:39653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260619 06:43:59.955792 1008 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.125:39653: Network error: Client connection negotiation failed: client connection to 127.10.192.125:39653: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.125.keytab.
Entry for principal kudu/127.10.192.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.125.keytab.
I20260619 06:43:59.971338 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.125:39653
--webserver_interface=127.10.192.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.125.keytab
--principal=kudu/127.10.192.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:43333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:34563,127.10.192.125:39653,127.10.192.124:41673
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:44:00.005131 1008 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } attempt: 1
I20260619 06:44:00.006390 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.005917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:39653 (local address 127.0.0.1:48612)
0619 06:44:00.006123 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.006259 (+ 136us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:39653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260619 06:44:00.007472 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.007135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:39653 (local address 127.0.0.1:48620)
0619 06:44:00.007272 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.007349 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:39653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260619 06:44:00.007809 1008 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.125:39653: Network error: Client connection negotiation failed: client connection to 127.10.192.125:39653: connect: Connection refused (error 111)
I20260619 06:44:00.076077 1008 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } attempt: 2
I20260619 06:44:00.077502 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.076884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:39653 (local address 127.0.0.1:48628)
0619 06:44:00.077134 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.077245 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:39653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260619 06:44:00.079301 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.078806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:39653 (local address 127.0.0.1:48642)
0619 06:44:00.079023 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.079117 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:39653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260619 06:44:00.079777 1008 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.125:39653: Network error: Client connection negotiation failed: client connection to 127.10.192.125:39653: connect: Connection refused (error 111)
I20260619 06:44:00.171054 1008 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } attempt: 3
I20260619 06:44:00.172466 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.171940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:39653 (local address 127.0.0.1:48658)
0619 06:44:00.172199 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.172314 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:39653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129}
I20260619 06:44:00.173539 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.173170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:39653 (local address 127.0.0.1:48662)
0619 06:44:00.173340 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.173409 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:39653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260619 06:44:00.173734 1008 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.125:39653: Network error: Client connection negotiation failed: client connection to 127.10.192.125:39653: connect: Connection refused (error 111)
W20260619 06:44:00.315009 1015 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260619 06:44:00.315421 1015 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:44:00.315526 1015 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:44:00.315727 1015 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260619 06:44:00.316977 1008 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } attempt: 4
I20260619 06:44:00.318171 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.317626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:39653 (local address 127.0.0.1:48676)
0619 06:44:00.317940 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.318038 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:39653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157}
I20260619 06:44:00.319221 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.318869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:39653 (local address 127.0.0.1:48690)
0619 06:44:00.319012 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.319103 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:39653: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260619 06:44:00.319442 1008 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.125:39653: Network error: Client connection negotiation failed: client connection to 127.10.192.125:39653: connect: Connection refused (error 111)
W20260619 06:44:00.323444 1015 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:44:00.323529 1015 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:44:00.323634 1015 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:44:00.323750 1015 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:44:00.323843 1015 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:44:00.333949 1015 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:43333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:34563,127.10.192.125:39653,127.10.192.124:41673
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.125.keytab
--principal=kudu/127.10.192.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.125:39653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.192.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:44:00.335408 1015 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:44:00.336860 1015 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:44:00.349362 1020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:44:00.349325 1021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:44:00.349329 1023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:44:00.350142 1015 server_base.cc:1034] running on GCE node
I20260619 06:44:00.351075 1015 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:44:00.352654 1015 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:44:00.353924 1015 hybrid_clock.cc:648] HybridClock initialized: now 1781851440353865 us; error 41 us; skew 500 ppm
I20260619 06:44:00.354262 1015 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:44:00 dist-test-slave-7lz4 krb5kdc[928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851440, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:44:00.357740 1015 init.cc:377] Logged in from keytab as kudu/127.10.192.125@KRBTEST.COM (short username kudu)
I20260619 06:44:00.359231 1015 webserver.cc:460] Webserver started at http://127.10.192.125:36981/ using document root <none> and password file <none>
I20260619 06:44:00.360008 1015 fs_manager.cc:359] Metadata directory not provided
I20260619 06:44:00.360188 1015 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:44:00.360493 1015 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:44:00.363564 1015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-1/data/instance:
uuid: "18c2793a69774b249432b530dff9c12f"
format_stamp: "Formatted at 2026-06-19 06:44:00 on dist-test-slave-7lz4"
server_key: "33472791cf35245e1a8f7ed561242a80"
server_key_iv: "18291a7e38e48f7031e0c24ce0b83071"
server_key_version: "encryptionkey@0"
I20260619 06:44:00.364367 1015 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-1/wal/instance:
uuid: "18c2793a69774b249432b530dff9c12f"
format_stamp: "Formatted at 2026-06-19 06:44:00 on dist-test-slave-7lz4"
server_key: "33472791cf35245e1a8f7ed561242a80"
server_key_iv: "18291a7e38e48f7031e0c24ce0b83071"
server_key_version: "encryptionkey@0"
I20260619 06:44:00.369674 1015 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 06:44:00.373154 1030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:44:00.374732 1015 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 06:44:00.374960 1015 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-1/wal
uuid: "18c2793a69774b249432b530dff9c12f"
format_stamp: "Formatted at 2026-06-19 06:44:00 on dist-test-slave-7lz4"
server_key: "33472791cf35245e1a8f7ed561242a80"
server_key_iv: "18291a7e38e48f7031e0c24ce0b83071"
server_key_version: "encryptionkey@0"
I20260619 06:44:00.375202 1015 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:44:00.386451 1015 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:44:00.391237 1015 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:44:00.391538 1015 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:44:00.410265 1015 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.125:39653
I20260619 06:44:00.410274 1081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.125:39653 every 8 connection(s)
I20260619 06:44:00.411724 1015 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-1/data/info.pb
I20260619 06:44:00.415457 1082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:44:00.417946 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 1015
I20260619 06:44:00.418135 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-1/wal/instance
I20260619 06:44:00.418644 11009 external_mini_cluster.cc:1428] Setting key 196d0dbbe51f0e7430a554ff4b0e00aa
I20260619 06:44:00.424942 1082 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 06:44:00 dist-test-slave-7lz4 krb5kdc[928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851440, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.125@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.192.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.124@KRBTEST.COM" created.
I20260619 06:44:00.446717 1012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.428453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56206 (local address 127.10.192.126:34563)
0619 06:44:00.428705 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:00.428713 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:00.430070 (+ 1357us) server_negotiation.cc:407] Connection header received
0619 06:44:00.432065 (+ 1995us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:00.432072 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:00.432171 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:00.432294 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:00.433850 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.434552 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.436204 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.436627 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.436776 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:00.440499 (+ 3723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:00.440506 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:00.440510 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:00.440559 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:00.443379 (+ 2820us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:00.444226 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:00.444231 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:00.444233 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:00.444365 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:00.444805 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:00.444810 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:00.444815 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:00.445101 (+ 286us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:00.445263 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:00.446104 (+ 841us) server_negotiation.cc:299] Negotiation successful
0619 06:44:00.446356 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260619 06:44:00.448153 1085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.428985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:34563 (local address 127.0.0.1:56206)
0619 06:44:00.429892 (+ 907us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.429947 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0619 06:44:00.431776 (+ 1829us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:44:00.432540 (+ 764us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:44:00.432549 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:44:00.433088 (+ 539us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:44:00.433659 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:00.433678 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.434740 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.434744 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:00.436041 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:00.436054 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.436881 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.436889 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:00.437130 (+ 241us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:00.437905 (+ 775us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:44:00.437928 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:44:00.440214 (+ 2286us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:44:00.443528 (+ 3314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:00.443538 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:00.443556 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:00.444083 (+ 527us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:00.444489 (+ 406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:00.444494 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:00.444498 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:00.444681 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:00.445235 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:44:00.445284 (+ 49us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:44:00.445709 (+ 425us) client_negotiation.cc:769] Sending connection context
0619 06:44:00.445989 (+ 280us) client_negotiation.cc:240] Negotiation successful
0619 06:44:00.446640 (+ 651us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":591,"thread_start_us":370,"threads_started":1}
I20260619 06:44:00.450089 1082 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 06:44:00 dist-test-slave-7lz4 krb5kdc[928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851440, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.125@KRBTEST.COM for kudu/127.10.192.125@KRBTEST.COM
I20260619 06:44:00.467092 1085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.451048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:39653 (local address 127.0.0.1:48698)
0619 06:44:00.451266 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.451286 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:44:00.451395 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:44:00.452355 (+ 960us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:44:00.452366 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:44:00.452877 (+ 511us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:44:00.453092 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:00.453106 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.454541 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.454549 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:00.456137 (+ 1588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:00.456155 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.457478 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.457482 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:00.457618 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:00.458237 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:44:00.458253 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:44:00.460403 (+ 2150us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:44:00.464757 (+ 4354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:00.464762 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:00.464764 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:00.465126 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:00.465537 (+ 411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:00.465540 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:00.465543 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:00.465675 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:00.466399 (+ 724us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:44:00.466402 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:44:00.466511 (+ 109us) client_negotiation.cc:769] Sending connection context
0619 06:44:00.466616 (+ 105us) client_negotiation.cc:240] Negotiation successful
0619 06:44:00.466814 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260619 06:44:00.467597 1086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.451168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48698 (local address 127.10.192.125:39653)
0619 06:44:00.451924 (+ 756us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:00.451930 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:00.451957 (+ 27us) server_negotiation.cc:407] Connection header received
0619 06:44:00.452006 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:00.452011 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:00.452187 (+ 176us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:00.452313 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:00.453293 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.454391 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.456298 (+ 1907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.457319 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.457485 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:00.460631 (+ 3146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:00.460647 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:00.460667 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:00.460720 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:00.464616 (+ 3896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:00.465264 (+ 648us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:00.465276 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:00.465282 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:00.465429 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:00.465779 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:00.465787 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:00.465793 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:00.466274 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:00.466494 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:00.466818 (+ 324us) server_negotiation.cc:299] Negotiation successful
0619 06:44:00.467102 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":611,"thread_start_us":429,"threads_started":1}
I20260619 06:44:00.470227 1082 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } has no permanent_uuid. Determining permanent_uuid...
I20260619 06:44:00.471441 1085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.471030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60348)
0619 06:44:00.471192 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.471293 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260619 06:44:00.471747 1033 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
I20260619 06:44:00.473328 1085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.473009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60360)
0619 06:44:00.473162 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.473237 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260619 06:44:00.473560 1082 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:41673: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.124.keytab.
Entry for principal kudu/127.10.192.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.124.keytab.
I20260619 06:44:00.483721 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.124:41673
--webserver_interface=127.10.192.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.124.keytab
--principal=kudu/127.10.192.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:43333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:34563,127.10.192.125:39653,127.10.192.124:41673
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:44:00.522866 1082 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } attempt: 1
I20260619 06:44:00.524112 1085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.523621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60376)
0619 06:44:00.523859 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.523962 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260619 06:44:00.525118 1085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.524768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60384)
0619 06:44:00.524940 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.525013 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260619 06:44:00.525317 1082 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:41673: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
I20260619 06:44:00.593627 1082 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } attempt: 2
I20260619 06:44:00.594816 1085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.594358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60396)
0619 06:44:00.594560 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.594660 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260619 06:44:00.595880 1085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.595495 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60410)
0619 06:44:00.595673 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.595755 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260619 06:44:00.596099 1082 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:41673: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
I20260619 06:44:00.618696 1008 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } attempt: 5
Jun 19 06:44:00 dist-test-slave-7lz4 krb5kdc[928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851439, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for kudu/127.10.192.125@KRBTEST.COM
I20260619 06:44:00.632711 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.619432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:39653 (local address 127.0.0.1:48712)
0619 06:44:00.619664 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.619688 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0619 06:44:00.619825 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:44:00.620215 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:44:00.620221 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:44:00.620640 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:44:00.620832 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:00.620842 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.621830 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.621836 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:00.622690 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:00.622702 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.623579 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.623585 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:00.623836 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:00.624490 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:44:00.624509 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:44:00.626859 (+ 2350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:44:00.630101 (+ 3242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:00.630107 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:00.630112 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:00.630546 (+ 434us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:00.630947 (+ 401us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:00.630953 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:00.630956 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:00.631107 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:00.631689 (+ 582us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:44:00.631694 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:44:00.631867 (+ 173us) client_negotiation.cc:769] Sending connection context
0619 06:44:00.632021 (+ 154us) client_negotiation.cc:240] Negotiation successful
0619 06:44:00.632362 (+ 341us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260619 06:44:00.632706 1086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.619579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48712 (local address 127.10.192.125:39653)
0619 06:44:00.619801 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:00.619807 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:00.619838 (+ 31us) server_negotiation.cc:407] Connection header received
0619 06:44:00.619985 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:00.619990 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:00.620055 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:00.620167 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:00.620985 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.621686 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.622853 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.623412 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.623557 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:00.627068 (+ 3511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:00.627073 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:00.627076 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:00.627108 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:00.629914 (+ 2806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:00.630678 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:00.630683 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:00.630687 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:00.630827 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:00.631217 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:00.631224 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:00.631227 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:00.631538 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:00.631720 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:00.632137 (+ 417us) server_negotiation.cc:299] Negotiation successful
0619 06:44:00.632382 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260619 06:44:00.633985 1008 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } has no permanent_uuid. Determining permanent_uuid...
I20260619 06:44:00.635038 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.634645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60416)
0619 06:44:00.634824 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.634905 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260619 06:44:00.636098 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.635781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60430)
0619 06:44:00.635927 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.635994 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
W20260619 06:44:00.636399 1008 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:41673: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
I20260619 06:44:00.687325 1082 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } attempt: 3
I20260619 06:44:00.687721 1008 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } attempt: 1
I20260619 06:44:00.688735 1085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.688140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60442)
0619 06:44:00.688388 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.688506 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260619 06:44:00.688786 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.688374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60458)
0619 06:44:00.688546 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.688633 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260619 06:44:00.689901 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.689508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60470)
0619 06:44:00.689662 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.689753 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260619 06:44:00.690027 1085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.689522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60462)
0619 06:44:00.689781 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.689872 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152}
W20260619 06:44:00.690143 1008 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:41673: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
W20260619 06:44:00.690371 1082 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:41673: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
I20260619 06:44:00.758411 1008 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } attempt: 2
I20260619 06:44:00.759759 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.759146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60482)
0619 06:44:00.759411 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.759526 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260619 06:44:00.760736 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.760387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60490)
0619 06:44:00.760550 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.760633 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260619 06:44:00.761143 1008 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:41673: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
W20260619 06:44:00.830117 1089 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260619 06:44:00.830524 1089 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:44:00.830653 1089 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:44:00.830794 1089 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260619 06:44:00.833593 1082 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } attempt: 4
I20260619 06:44:00.834872 1085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.834326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60492)
0619 06:44:00.834612 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.834709 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128}
I20260619 06:44:00.835952 1085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.835565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60498)
0619 06:44:00.835754 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.835844 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260619 06:44:00.836172 1082 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:41673: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
W20260619 06:44:00.838977 1089 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:44:00.839110 1089 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:44:00.839233 1089 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:44:00.839322 1089 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:44:00.839430 1089 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:44:00.849825 1089 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:43333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:34563,127.10.192.125:39653,127.10.192.124:41673
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.124.keytab
--principal=kudu/127.10.192.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.124:41673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.192.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:44:00.851190 1089 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:44:00.852622 1089 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:44:00.865182 1094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:44:00.865226 1097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:44:00.865257 1095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:44:00.866425 1089 server_base.cc:1034] running on GCE node
I20260619 06:44:00.867188 1089 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:44:00.867419 1008 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } attempt: 3
I20260619 06:44:00.868510 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.868037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60510)
0619 06:44:00.868227 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.868314 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260619 06:44:00.868986 1089 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:44:00.869561 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.869200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60516)
0619 06:44:00.869385 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.869464 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
W20260619 06:44:00.869848 1008 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:41673: Network error: Client connection negotiation failed: client connection to 127.10.192.124:41673: connect: Connection refused (error 111)
I20260619 06:44:00.870224 1089 hybrid_clock.cc:648] HybridClock initialized: now 1781851440870155 us; error 42 us; skew 500 ppm
I20260619 06:44:00.870630 1089 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:44:00 dist-test-slave-7lz4 krb5kdc[928](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851440, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:44:00.873844 1089 init.cc:377] Logged in from keytab as kudu/127.10.192.124@KRBTEST.COM (short username kudu)
I20260619 06:44:00.875253 1089 webserver.cc:460] Webserver started at http://127.10.192.124:36435/ using document root <none> and password file <none>
I20260619 06:44:00.876032 1089 fs_manager.cc:359] Metadata directory not provided
I20260619 06:44:00.876122 1089 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:44:00.876398 1089 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:44:00.879555 1089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-2/data/instance:
uuid: "9c71a2c4563e44f5ad622a705c9207ee"
format_stamp: "Formatted at 2026-06-19 06:44:00 on dist-test-slave-7lz4"
server_key: "636a9b8422057b9204985a05cbee285c"
server_key_iv: "032b70a703508d70fd836c99e3b0ea46"
server_key_version: "encryptionkey@0"
I20260619 06:44:00.880438 1089 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-2/wal/instance:
uuid: "9c71a2c4563e44f5ad622a705c9207ee"
format_stamp: "Formatted at 2026-06-19 06:44:00 on dist-test-slave-7lz4"
server_key: "636a9b8422057b9204985a05cbee285c"
server_key_iv: "032b70a703508d70fd836c99e3b0ea46"
server_key_version: "encryptionkey@0"
I20260619 06:44:00.885793 1089 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260619 06:44:00.889340 1104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:44:00.890851 1089 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 06:44:00.890995 1089 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-2/wal
uuid: "9c71a2c4563e44f5ad622a705c9207ee"
format_stamp: "Formatted at 2026-06-19 06:44:00 on dist-test-slave-7lz4"
server_key: "636a9b8422057b9204985a05cbee285c"
server_key_iv: "032b70a703508d70fd836c99e3b0ea46"
server_key_version: "encryptionkey@0"
I20260619 06:44:00.891178 1089 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:44:00.929792 1089 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:44:00.933935 1089 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:44:00.934173 1089 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:44:00.953720 1089 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.124:41673
I20260619 06:44:00.953727 1155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.124:41673 every 8 connection(s)
I20260619 06:44:00.955178 1089 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-2/data/info.pb
I20260619 06:44:00.959064 1156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:44:00.959657 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 1089
I20260619 06:44:00.959862 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1781851080573990-11009-0/minicluster-data/master-2/wal/instance
I20260619 06:44:00.960399 11009 external_mini_cluster.cc:1428] Setting key 4940b1ae082f51b82eb2702fe1c40276
I20260619 06:44:00.969105 1156 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 06:44:00 dist-test-slave-7lz4 krb5kdc[928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.124@KRBTEST.COM
Jun 19 06:44:00 dist-test-slave-7lz4 krb5kdc[928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851440, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.124@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:44:00.986277 1159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.962486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60522 (local address 127.10.192.124:41673)
0619 06:44:00.963353 (+ 867us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:00.963369 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:00.963414 (+ 45us) server_negotiation.cc:407] Connection header received
0619 06:44:00.965699 (+ 2285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:00.965723 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:00.966183 (+ 460us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:00.966548 (+ 365us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:00.968383 (+ 1835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.969843 (+ 1460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.971725 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.972791 (+ 1066us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.973031 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:00.977828 (+ 4797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:00.977840 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:00.977856 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:00.977906 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:00.981777 (+ 3871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:00.982545 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:00.982552 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:00.982559 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:00.982701 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:00.983114 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:00.983117 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:00.983119 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:00.983854 (+ 735us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:00.984090 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:00.984614 (+ 524us) server_negotiation.cc:299] Negotiation successful
0619 06:44:00.985104 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":645,"thread_start_us":420,"threads_started":1}
I20260619 06:44:00.988976 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.972202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56214 (local address 127.10.192.126:34563)
0619 06:44:00.972821 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:00.972827 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:00.973384 (+ 557us) server_negotiation.cc:407] Connection header received
0619 06:44:00.973639 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:00.973644 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:00.973708 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:00.973795 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:00.974959 (+ 1164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.976222 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.977855 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.978290 (+ 435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.978452 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:00.982464 (+ 4012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:00.982474 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:00.982482 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:00.982529 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:00.985889 (+ 3360us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:00.986745 (+ 856us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:00.986751 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:00.986756 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:00.986941 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:00.987320 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:00.987325 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:00.987328 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:00.987738 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:00.987914 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:00.988505 (+ 591us) server_negotiation.cc:299] Negotiation successful
0619 06:44:00.988683 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":463,"thread_start_us":305,"threads_started":1}
I20260619 06:44:00.989226 1161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.972246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:34563 (local address 127.0.0.1:56214)
0619 06:44:00.973227 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.973283 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0619 06:44:00.973461 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:44:00.973918 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:44:00.973924 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:44:00.974538 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:44:00.974785 (+ 247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:00.974793 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.976382 (+ 1589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.976388 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:00.977686 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:00.977699 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.978501 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.978509 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:00.978763 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:00.979395 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:44:00.979418 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:44:00.982255 (+ 2837us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:44:00.986022 (+ 3767us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:00.986033 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:00.986039 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:00.986606 (+ 567us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:00.987082 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:00.987085 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:00.987088 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:00.987208 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:00.987913 (+ 705us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:44:00.987921 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:44:00.988134 (+ 213us) client_negotiation.cc:769] Sending connection context
0619 06:44:00.988366 (+ 232us) client_negotiation.cc:240] Negotiation successful
0619 06:44:00.988683 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":721,"thread_start_us":550,"threads_started":1}
I20260619 06:44:00.990666 1156 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 06:44:00 dist-test-slave-7lz4 krb5kdc[928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851440, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.124@KRBTEST.COM for kudu/127.10.192.125@KRBTEST.COM
Jun 19 06:44:00 dist-test-slave-7lz4 krb5kdc[928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:44:01.004331 1161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.991334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:39653 (local address 127.0.0.1:48718)
0619 06:44:00.991523 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:00.991540 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0619 06:44:00.991689 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:44:00.991983 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:44:00.991989 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:44:00.992442 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:44:00.992664 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:00.992674 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.993733 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.993740 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:00.994781 (+ 1041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:00.994792 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.995511 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.995517 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:00.995759 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:00.996441 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:44:00.996458 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:44:00.998717 (+ 2259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:44:01.001847 (+ 3130us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:01.001852 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:01.001856 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:01.002232 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:01.002641 (+ 409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:01.002646 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:01.002650 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:01.002799 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:01.003323 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:44:01.003328 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:44:01.003502 (+ 174us) client_negotiation.cc:769] Sending connection context
0619 06:44:01.003659 (+ 157us) client_negotiation.cc:240] Negotiation successful
0619 06:44:01.003965 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260619 06:44:01.004379 1086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.991474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48718 (local address 127.10.192.125:39653)
0619 06:44:00.991704 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:00.991709 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:00.991730 (+ 21us) server_negotiation.cc:407] Connection header received
0619 06:44:00.991786 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:00.991790 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:00.991845 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:00.991922 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:00.992810 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.993592 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.994928 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.995354 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.995515 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:00.998941 (+ 3426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:00.998946 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:00.998950 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:00.998984 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:01.001691 (+ 2707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:01.002366 (+ 675us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:01.002373 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:01.002382 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:01.002519 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:01.002916 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:01.002922 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:01.002926 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:01.003198 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:01.003370 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:01.003755 (+ 385us) server_negotiation.cc:299] Negotiation successful
0619 06:44:01.003972 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260619 06:44:01.005461 1156 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } has no permanent_uuid. Determining permanent_uuid...
I20260619 06:44:01.005792 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:00.990328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56230 (local address 127.10.192.126:34563)
0619 06:44:00.990483 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:00.990489 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:00.990527 (+ 38us) server_negotiation.cc:407] Connection header received
0619 06:44:00.990730 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:00.990735 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:00.990818 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:00.990929 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:00.992604 (+ 1675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.993593 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.994901 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:00.995340 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:00.995476 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:01.000190 (+ 4714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:01.000195 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:01.000199 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:01.000233 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:01.002991 (+ 2758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:01.003701 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:01.003708 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:01.003714 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:01.003850 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:01.004224 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:01.004229 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:01.004233 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:01.004607 (+ 374us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:01.004895 (+ 288us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:01.005234 (+ 339us) server_negotiation.cc:299] Negotiation successful
0619 06:44:01.005490 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
Jun 19 06:44:01 dist-test-slave-7lz4 krb5kdc[928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851440, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.124@KRBTEST.COM for kudu/127.10.192.124@KRBTEST.COM
Jun 19 06:44:01 dist-test-slave-7lz4 krb5kdc[928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851439, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.125@KRBTEST.COM
I20260619 06:44:01.020530 1161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:01.006257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60530)
0619 06:44:01.006460 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:01.006479 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:44:01.006590 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:44:01.007017 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:44:01.007020 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:44:01.007473 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:44:01.007674 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:01.007686 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.008969 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.008977 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:01.010323 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:01.010339 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.010985 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.010990 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:01.011189 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:01.011854 (+ 665us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:44:01.011878 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:44:01.014203 (+ 2325us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:44:01.017861 (+ 3658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:01.017869 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:01.017876 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:01.018272 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:01.018771 (+ 499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:01.018779 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:01.018784 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:01.019013 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:01.019761 (+ 748us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:44:01.019765 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:44:01.019905 (+ 140us) client_negotiation.cc:769] Sending connection context
0619 06:44:01.020026 (+ 121us) client_negotiation.cc:240] Negotiation successful
0619 06:44:01.020252 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260619 06:44:01.020844 1159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:01.006550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60530 (local address 127.10.192.124:41673)
0619 06:44:01.006694 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:01.006698 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:01.006733 (+ 35us) server_negotiation.cc:407] Connection header received
0619 06:44:01.006783 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:01.006791 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:01.006879 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:01.006976 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:01.008179 (+ 1203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.008849 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.010430 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.010829 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.010970 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:01.014383 (+ 3413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:01.014388 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:01.014391 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:01.014418 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:01.017650 (+ 3232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:01.018390 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:01.018396 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:01.018399 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:01.018549 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:01.019149 (+ 600us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:01.019154 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:01.019157 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:01.019537 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:01.019724 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:01.020162 (+ 438us) server_negotiation.cc:299] Negotiation successful
0619 06:44:01.020421 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260619 06:44:01.023676 1086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:01.007707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48734 (local address 127.10.192.125:39653)
0619 06:44:01.007892 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:01.007896 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:01.007909 (+ 13us) server_negotiation.cc:407] Connection header received
0619 06:44:01.007945 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:01.007948 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:01.007997 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:01.008068 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:01.009204 (+ 1136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.010248 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.011406 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.012031 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.012151 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:01.016992 (+ 4841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:01.016998 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:01.017003 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:01.017046 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:01.020643 (+ 3597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:01.021498 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:01.021502 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:01.021504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:01.021644 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:01.022119 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:01.022124 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:01.022128 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:01.022533 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:01.022825 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:01.023047 (+ 222us) server_negotiation.cc:299] Negotiation successful
0619 06:44:01.023317 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260619 06:44:01.027122 1156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee: Bootstrap starting.
I20260619 06:44:01.029047 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:44:01.031242 1156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee: Neither blocks nor log segments found. Creating new log.
I20260619 06:44:01.032632 1156 log.cc:824] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee: Log is configured to *not* fsync() on all Append() calls
I20260619 06:44:01.032550 983 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "557ded928f204f64aa4f39084e782a35"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56230
I20260619 06:44:01.035621 1156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee: No bootstrap required, opened a new log
I20260619 06:44:01.042788 1156 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557ded928f204f64aa4f39084e782a35" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } } peers { permanent_uuid: "18c2793a69774b249432b530dff9c12f" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } } peers { permanent_uuid: "9c71a2c4563e44f5ad622a705c9207ee" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } }
I20260619 06:44:01.043159 1156 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c71a2c4563e44f5ad622a705c9207ee, State: Initialized, Role: FOLLOWER
I20260619 06:44:01.043627 1156 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557ded928f204f64aa4f39084e782a35" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } } peers { permanent_uuid: "18c2793a69774b249432b530dff9c12f" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } } peers { permanent_uuid: "9c71a2c4563e44f5ad622a705c9207ee" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } }
I20260619 06:44:01.044631 1163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557ded928f204f64aa4f39084e782a35" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } } peers { permanent_uuid: "18c2793a69774b249432b530dff9c12f" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } } peers { permanent_uuid: "9c71a2c4563e44f5ad622a705c9207ee" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } } }
I20260619 06:44:01.045020 1163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:44:01.045629 1156 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:44:01.047068 1008 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } attempt: 4
W20260619 06:44:01.056818 1174 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 06:44:01.057098 1174 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Jun 19 06:44:01 dist-test-slave-7lz4 krb5kdc[928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851439, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for kudu/127.10.192.124@KRBTEST.COM
I20260619 06:44:01.066085 1011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:01.048022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60540)
0619 06:44:01.048349 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:01.048370 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0619 06:44:01.048530 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:44:01.048935 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:44:01.048940 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:44:01.049593 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:44:01.049881 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:01.049896 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.051189 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.051196 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:01.052726 (+ 1530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:01.052742 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.054068 (+ 1326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.054074 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:01.054304 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:01.055012 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:44:01.055039 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:44:01.057930 (+ 2891us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:44:01.062874 (+ 4944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:01.062879 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:01.062884 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:01.063449 (+ 565us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:01.063938 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:01.063946 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:01.063950 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:01.064111 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:01.065001 (+ 890us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:44:01.065008 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:44:01.065206 (+ 198us) client_negotiation.cc:769] Sending connection context
0619 06:44:01.065381 (+ 175us) client_negotiation.cc:240] Negotiation successful
0619 06:44:01.065677 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178}
I20260619 06:44:01.067255 1159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:01.048083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60540 (local address 127.10.192.124:41673)
0619 06:44:01.048339 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:01.048344 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:01.048438 (+ 94us) server_negotiation.cc:407] Connection header received
0619 06:44:01.048661 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:01.048669 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:01.048762 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:01.048880 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:01.050066 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.051019 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.052874 (+ 1855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.053567 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.053695 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:01.058164 (+ 4469us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:01.058171 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:01.058178 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:01.058221 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:01.062692 (+ 4471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:01.063602 (+ 910us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:01.063607 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:01.063610 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:01.063790 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:01.064259 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:01.064265 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:01.064269 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:01.064774 (+ 505us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:01.064936 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:01.066590 (+ 1654us) server_negotiation.cc:299] Negotiation successful
0619 06:44:01.066859 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260619 06:44:01.055789 1089 master_runner.cc:186] Error getting master registration for 127.10.192.126:34563: OK, instance_id { permanent_uuid: "557ded928f204f64aa4f39084e782a35" instance_seqno: 1781851439901401 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 06:44:01.068308 1089 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260619 06:44:01.072149 1008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35: Bootstrap starting.
I20260619 06:44:01.075207 1008 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35: Neither blocks nor log segments found. Creating new log.
I20260619 06:44:01.076362 1008 log.cc:824] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35: Log is configured to *not* fsync() on all Append() calls
I20260619 06:44:01.079202 1008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35: No bootstrap required, opened a new log
I20260619 06:44:01.086427 1008 raft_consensus.cc:348] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557ded928f204f64aa4f39084e782a35" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } } peers { permanent_uuid: "18c2793a69774b249432b530dff9c12f" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } } peers { permanent_uuid: "9c71a2c4563e44f5ad622a705c9207ee" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } }
I20260619 06:44:01.086814 1008 raft_consensus.cc:729] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 557ded928f204f64aa4f39084e782a35, State: Initialized, Role: FOLLOWER
I20260619 06:44:01.087302 1008 consensus_queue.cc:260] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557ded928f204f64aa4f39084e782a35" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } } peers { permanent_uuid: "18c2793a69774b249432b530dff9c12f" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } } peers { permanent_uuid: "9c71a2c4563e44f5ad622a705c9207ee" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } }
I20260619 06:44:01.088289 1177 sys_catalog.cc:455] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557ded928f204f64aa4f39084e782a35" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } } peers { permanent_uuid: "18c2793a69774b249432b530dff9c12f" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } } peers { permanent_uuid: "9c71a2c4563e44f5ad622a705c9207ee" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } } }
I20260619 06:44:01.088642 1177 sys_catalog.cc:458] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:44:01.089573 1008 sys_catalog.cc:564] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:44:01.091945 983 raft_consensus.cc:482] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260619 06:44:01.092219 983 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:44:01.095796 983 raft_consensus.cc:504] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557ded928f204f64aa4f39084e782a35" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } } peers { permanent_uuid: "18c2793a69774b249432b530dff9c12f" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } } peers { permanent_uuid: "9c71a2c4563e44f5ad622a705c9207ee" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } }
I20260619 06:44:01.099200 1131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "557ded928f204f64aa4f39084e782a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9c71a2c4563e44f5ad622a705c9207ee"
I20260619 06:44:01.099752 1131 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:44:01.103394 1131 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557ded928f204f64aa4f39084e782a35 in term 1.
I20260619 06:44:01.103930 983 leader_election.cc:288] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [CANDIDATE]: Term 1 election: Requested vote from peers 18c2793a69774b249432b530dff9c12f (127.10.192.125:39653), 9c71a2c4563e44f5ad622a705c9207ee (127.10.192.124:41673)
I20260619 06:44:01.104334 959 leader_election.cc:302] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 557ded928f204f64aa4f39084e782a35, 9c71a2c4563e44f5ad622a705c9207ee; no voters:
I20260619 06:44:01.104888 1177 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:44:01.124130 1177 raft_consensus.cc:686] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [term 1 LEADER]: Becoming Leader. State: Replica: 557ded928f204f64aa4f39084e782a35, State: Running, Role: LEADER
I20260619 06:44:01.124974 1177 consensus_queue.cc:237] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557ded928f204f64aa4f39084e782a35" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } } peers { permanent_uuid: "18c2793a69774b249432b530dff9c12f" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } } peers { permanent_uuid: "9c71a2c4563e44f5ad622a705c9207ee" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } }
I20260619 06:44:01.130173 1183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 557ded928f204f64aa4f39084e782a35. Latest consensus state: current_term: 1 leader_uuid: "557ded928f204f64aa4f39084e782a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557ded928f204f64aa4f39084e782a35" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } } peers { permanent_uuid: "18c2793a69774b249432b530dff9c12f" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } } peers { permanent_uuid: "9c71a2c4563e44f5ad622a705c9207ee" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } } }
I20260619 06:44:01.131199 1183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [sys.catalog]: This master's current role is: LEADER
I20260619 06:44:01.135349 1082 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } attempt: 5
W20260619 06:44:01.140234 962 tablet.cc:2369] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:44:01.144335 1191 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Jun 19 06:44:01 dist-test-slave-7lz4 krb5kdc[928](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851440, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.125@KRBTEST.COM for kudu/127.10.192.124@KRBTEST.COM
I20260619 06:44:01.162484 1085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:01.136044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:41673 (local address 127.0.0.1:60546)
0619 06:44:01.136474 (+ 430us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:01.136496 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 06:44:01.136615 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:44:01.137760 (+ 1145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:44:01.137769 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:44:01.138384 (+ 615us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:44:01.138620 (+ 236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:01.138634 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.140866 (+ 2232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.140873 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:01.142696 (+ 1823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:01.142718 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.144117 (+ 1399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.144123 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:01.144406 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:01.145136 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:44:01.145159 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:44:01.148143 (+ 2984us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:44:01.156346 (+ 8203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:01.156357 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:01.156364 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:01.157024 (+ 660us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:01.159109 (+ 2085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:01.159118 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:01.159125 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:01.159389 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:01.160979 (+ 1590us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:44:01.160987 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:44:01.161192 (+ 205us) client_negotiation.cc:769] Sending connection context
0619 06:44:01.161384 (+ 192us) client_negotiation.cc:240] Negotiation successful
0619 06:44:01.161947 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302}
I20260619 06:44:01.164258 1159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:01.136960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60546 (local address 127.10.192.124:41673)
0619 06:44:01.137177 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:01.137187 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:01.137208 (+ 21us) server_negotiation.cc:407] Connection header received
0619 06:44:01.137291 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:01.137296 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:01.137391 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:01.137538 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:01.139248 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.140654 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.142918 (+ 2264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.143734 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.143880 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:01.148450 (+ 4570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:01.148461 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:01.148469 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:01.148514 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:01.155260 (+ 6746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:01.158716 (+ 3456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:01.158726 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:01.158733 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:01.158948 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:01.159926 (+ 978us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:01.159935 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:01.159940 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:01.160724 (+ 784us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:01.160884 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:01.163375 (+ 2491us) server_negotiation.cc:299] Negotiation successful
0619 06:44:01.163712 (+ 337us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260619 06:44:01.170660 1082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f: Bootstrap starting.
I20260619 06:44:01.174834 1082 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f: Neither blocks nor log segments found. Creating new log.
I20260619 06:44:01.176218 1082 log.cc:824] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f: Log is configured to *not* fsync() on all Append() calls
I20260619 06:44:01.181329 1082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f: No bootstrap required, opened a new log
I20260619 06:44:01.184504 1191 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260619 06:44:01.186307 1110 tablet.cc:2369] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:44:01.191619 1201 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260619 06:44:01.206306 1131 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee [term 1 FOLLOWER]: Refusing update from remote peer 557ded928f204f64aa4f39084e782a35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:44:01.207686 1183 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9c71a2c4563e44f5ad622a705c9207ee" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:44:01.217576 1159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:01.150499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60560 (local address 127.10.192.124:41673)
0619 06:44:01.167294 (+ 16795us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:01.167303 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:01.180407 (+ 13104us) server_negotiation.cc:407] Connection header received
0619 06:44:01.188405 (+ 7998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:01.188415 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:01.188521 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:01.188607 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:01.191297 (+ 2690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.193239 (+ 1942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.195369 (+ 2130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.205519 (+ 10150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.205664 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:01.208931 (+ 3267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:01.208938 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:01.208943 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:01.208984 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:01.212966 (+ 3982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:01.214548 (+ 1582us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:01.214553 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:01.214557 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:01.214706 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:01.215148 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:01.215158 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:01.215163 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:01.215516 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:01.216772 (+ 1256us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:01.216904 (+ 132us) server_negotiation.cc:299] Negotiation successful
0619 06:44:01.217138 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16584,"thread_start_us":39005,"threads_started":1}
I20260619 06:44:01.221107 1086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:01.144166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48748 (local address 127.10.192.125:39653)
0619 06:44:01.144358 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:01.144366 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:01.149844 (+ 5478us) server_negotiation.cc:407] Connection header received
0619 06:44:01.151046 (+ 1202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:01.151053 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:01.151129 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:01.151197 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:01.160617 (+ 9420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.161913 (+ 1296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.187197 (+ 25284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.187905 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.188009 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:01.193669 (+ 5660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:01.193676 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:01.193680 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:01.193722 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:01.197529 (+ 3807us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:01.203583 (+ 6054us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:01.203590 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:01.203594 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:01.203792 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:01.204904 (+ 1112us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:01.204909 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:01.204913 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:01.205318 (+ 405us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:01.205539 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:01.220423 (+ 14884us) server_negotiation.cc:299] Negotiation successful
0619 06:44:01.220718 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260619 06:44:01.222196 1163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader 557ded928f204f64aa4f39084e782a35. Latest consensus state: current_term: 1 leader_uuid: "557ded928f204f64aa4f39084e782a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557ded928f204f64aa4f39084e782a35" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } } peers { permanent_uuid: "18c2793a69774b249432b530dff9c12f" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } } peers { permanent_uuid: "9c71a2c4563e44f5ad622a705c9207ee" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } } }
I20260619 06:44:01.222530 1163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:44:01.224170 1160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:01.142931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56234 (local address 127.10.192.126:34563)
0619 06:44:01.143132 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:01.143138 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:01.149375 (+ 6237us) server_negotiation.cc:407] Connection header received
0619 06:44:01.153422 (+ 4047us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:01.153428 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:01.153512 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:01.153582 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:01.157449 (+ 3867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.158620 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.183804 (+ 25184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:01.184572 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:01.184687 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:01.198513 (+ 13826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:01.198520 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:01.198527 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:01.198591 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:01.202650 (+ 4059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:01.204273 (+ 1623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:01.204284 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:01.204288 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:01.204456 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:01.206214 (+ 1758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:01.206221 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:01.206237 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:01.214155 (+ 7918us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:01.214479 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:01.223429 (+ 8950us) server_negotiation.cc:299] Negotiation successful
0619 06:44:01.223731 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260619 06:44:01.226701 1177 sys_catalog.cc:455] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "557ded928f204f64aa4f39084e782a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557ded928f204f64aa4f39084e782a35" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } } peers { permanent_uuid: "18c2793a69774b249432b530dff9c12f" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } } peers { permanent_uuid: "9c71a2c4563e44f5ad622a705c9207ee" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } } }
I20260619 06:44:01.227027 1177 sys_catalog.cc:458] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [sys.catalog]: This master's current role is: LEADER
I20260619 06:44:01.195992 941 master_runner.cc:186] Error getting master registration for 127.10.192.125:39653: OK, instance_id { permanent_uuid: "18c2793a69774b249432b530dff9c12f" instance_seqno: 1781851440404897 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 06:44:01.229204 941 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260619 06:44:01.234534 1191 catalog_manager.cc:1347] Generated new cluster ID: 5ed9ca1a93a74e548be82e21f3a6eb5b
I20260619 06:44:01.234674 1191 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:44:01.234769 1082 raft_consensus.cc:348] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557ded928f204f64aa4f39084e782a35" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } } peers { permanent_uuid: "18c2793a69774b249432b530dff9c12f" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } } peers { permanent_uuid: "9c71a2c4563e44f5ad622a705c9207ee" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } }
I20260619 06:44:01.235322 1082 raft_consensus.cc:729] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18c2793a69774b249432b530dff9c12f, State: Initialized, Role: FOLLOWER
I20260619 06:44:01.235919 1082 consensus_queue.cc:260] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557ded928f204f64aa4f39084e782a35" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } } peers { permanent_uuid: "18c2793a69774b249432b530dff9c12f" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } } peers { permanent_uuid: "9c71a2c4563e44f5ad622a705c9207ee" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } }
I20260619 06:44:01.252684 1163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "557ded928f204f64aa4f39084e782a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557ded928f204f64aa4f39084e782a35" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } } peers { permanent_uuid: "18c2793a69774b249432b530dff9c12f" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } } peers { permanent_uuid: "9c71a2c4563e44f5ad622a705c9207ee" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } } }
I20260619 06:44:01.252976 1163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:44:01.262475 1207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557ded928f204f64aa4f39084e782a35" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } } peers { permanent_uuid: "18c2793a69774b249432b530dff9c12f" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } } peers { permanent_uuid: "9c71a2c4563e44f5ad622a705c9207ee" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } } }
I20260619 06:44:01.263746 1207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:44:01.264112 1082 sys_catalog.cc:564] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:44:01.264128 1057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "557ded928f204f64aa4f39084e782a35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "18c2793a69774b249432b530dff9c12f"
I20260619 06:44:01.264488 1056 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:44:01.267756 1056 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f [term 1 FOLLOWER]: Refusing update from remote peer 557ded928f204f64aa4f39084e782a35: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:44:01.271036 1057 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 557ded928f204f64aa4f39084e782a35 in term 1.
I20260619 06:44:01.275399 1183 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18c2793a69774b249432b530dff9c12f" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:44:01.285908 1191 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:44:01.288285 1191 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:44:01.305251 1191 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35: Generated new TSK 0
I20260619 06:44:01.306449 1191 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:44:01.363562 1217 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "557ded928f204f64aa4f39084e782a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557ded928f204f64aa4f39084e782a35" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } } peers { permanent_uuid: "18c2793a69774b249432b530dff9c12f" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } } peers { permanent_uuid: "9c71a2c4563e44f5ad622a705c9207ee" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } } }
I20260619 06:44:01.364180 1217 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:44:01.364316 1177 sys_catalog.cc:455] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "557ded928f204f64aa4f39084e782a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557ded928f204f64aa4f39084e782a35" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } } peers { permanent_uuid: "18c2793a69774b249432b530dff9c12f" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } } peers { permanent_uuid: "9c71a2c4563e44f5ad622a705c9207ee" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } } }
I20260619 06:44:01.364629 1177 sys_catalog.cc:458] T 00000000000000000000000000000000 P 557ded928f204f64aa4f39084e782a35 [sys.catalog]: This master's current role is: LEADER
I20260619 06:44:01.364665 1207 sys_catalog.cc:455] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 557ded928f204f64aa4f39084e782a35. Latest consensus state: current_term: 1 leader_uuid: "557ded928f204f64aa4f39084e782a35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "557ded928f204f64aa4f39084e782a35" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 34563 } } peers { permanent_uuid: "18c2793a69774b249432b530dff9c12f" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 39653 } } peers { permanent_uuid: "9c71a2c4563e44f5ad622a705c9207ee" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 41673 } } }
I20260619 06:44:01.365010 1207 sys_catalog.cc:458] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:44:01.389081 1224 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260619 06:44:01.457805 1160 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:01.443686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56250 (local address 127.10.192.126:34563)
0619 06:44:01.443913 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:01.443924 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:01.454482 (+ 10558us) server_negotiation.cc:407] Connection header received
0619 06:44:01.456083 (+ 1601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:01.456090 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:01.456184 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:01.456268 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:01.457565 (+ 1297us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:56250: BlockingRecv error: recv got EOF from 127.0.0.1:56250 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260619 06:44:01.458112 1086 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:01.443459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48756 (local address 127.10.192.125:39653)
0619 06:44:01.443898 (+ 439us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:01.443904 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:01.456294 (+ 12390us) server_negotiation.cc:407] Connection header received
0619 06:44:01.456587 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:01.456593 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:01.456694 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:01.456788 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:01.457895 (+ 1107us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48756: BlockingRecv error: recv got EOF from 127.0.0.1:48756 (error 108)
Metrics: {"server-negotiator.queue_time_us":300}
W20260619 06:44:01.458184 1159 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:01.455094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60568 (local address 127.10.192.124:41673)
0619 06:44:01.455306 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:01.455312 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:01.456587 (+ 1275us) server_negotiation.cc:407] Connection header received
0619 06:44:01.456820 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:01.456825 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:01.456906 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:01.456977 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:01.457961 (+ 984us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60568: BlockingRecv error: recv got EOF from 127.0.0.1:60568 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260619 06:44:01.465741 1086 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:01.463335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48762 (local address 127.10.192.125:39653)
0619 06:44:01.463515 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:01.463521 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:01.464139 (+ 618us) server_negotiation.cc:407] Connection header received
0619 06:44:01.464374 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:01.464380 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:01.464500 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:01.464608 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:01.465457 (+ 849us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48762: BlockingRecv error: recv got EOF from 127.0.0.1:48762 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260619 06:44:01.477851 1086 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:01.471079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48764 (local address 127.10.192.125:39653)
0619 06:44:01.471245 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:01.471250 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:01.476261 (+ 5011us) server_negotiation.cc:407] Connection header received
0619 06:44:01.476487 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:01.476492 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:01.476590 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:01.476702 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:01.477631 (+ 929us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48764: BlockingRecv error: recv got EOF from 127.0.0.1:48764 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260619 06:44:01.489881 1086 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:01.483209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48778 (local address 127.10.192.125:39653)
0619 06:44:01.483408 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:01.483414 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:01.488285 (+ 4871us) server_negotiation.cc:407] Connection header received
0619 06:44:01.488497 (+ 212us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:01.488503 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:01.488619 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:01.488740 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:01.489629 (+ 889us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48778: BlockingRecv error: recv got EOF from 127.0.0.1:48778 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
W20260619 06:44:01.505820 1086 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:01.501689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48780 (local address 127.10.192.125:39653)
0619 06:44:01.501919 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:01.501926 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:01.504222 (+ 2296us) server_negotiation.cc:407] Connection header received
0619 06:44:01.504433 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:01.504439 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:01.504546 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:01.504660 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:01.505570 (+ 910us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48780: BlockingRecv error: recv got EOF from 127.0.0.1:48780 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
W20260619 06:44:01.519773 1086 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:01.517473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48796 (local address 127.10.192.125:39653)
0619 06:44:01.517670 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:01.517676 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:01.518220 (+ 544us) server_negotiation.cc:407] Connection header received
0619 06:44:01.518437 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:01.518443 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:01.518543 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:01.518654 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:01.519499 (+ 845us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48796: BlockingRecv error: recv got EOF from 127.0.0.1:48796 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
W20260619 06:44:01.542279 1086 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:01.539380 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48806 (local address 127.10.192.125:39653)
0619 06:44:01.539603 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:01.539610 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:01.540196 (+ 586us) server_negotiation.cc:407] Connection header received
0619 06:44:01.540864 (+ 668us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:01.540870 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:01.540963 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:01.541071 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:01.542023 (+ 952us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48806: BlockingRecv error: recv got EOF from 127.0.0.1:48806 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
W20260619 06:44:01.580739 1086 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:01.577898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48816 (local address 127.10.192.125:39653)
0619 06:44:01.578138 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:01.578145 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:01.578968 (+ 823us) server_negotiation.cc:407] Connection header received
0619 06:44:01.579255 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:01.579261 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:01.579368 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:01.579486 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:01.580444 (+ 958us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48816: BlockingRecv error: recv got EOF from 127.0.0.1:48816 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
W20260619 06:44:01.650955 1086 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:01.648976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48818 (local address 127.10.192.125:39653)
0619 06:44:01.649247 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:01.649254 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:01.649626 (+ 372us) server_negotiation.cc:407] Connection header received
0619 06:44:01.649785 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:01.649791 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:01.649890 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:01.650031 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:01.650724 (+ 693us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48818: BlockingRecv error: recv got EOF from 127.0.0.1:48818 (error 108)
Metrics: {"server-negotiator.queue_time_us":102}
W20260619 06:44:01.784919 1086 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:01.782812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48826 (local address 127.10.192.125:39653)
0619 06:44:01.783130 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:01.783137 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:01.783465 (+ 328us) server_negotiation.cc:407] Connection header received
0619 06:44:01.783732 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:01.783740 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:01.783828 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:01.783948 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:01.784698 (+ 750us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48826: BlockingRecv error: recv got EOF from 127.0.0.1:48826 (error 108)
Metrics: {"server-negotiator.queue_time_us":136}
W20260619 06:44:02.048936 1086 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:02.046925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48830 (local address 127.10.192.125:39653)
0619 06:44:02.047164 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:02.047173 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:02.047389 (+ 216us) server_negotiation.cc:407] Connection header received
0619 06:44:02.047610 (+ 221us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:02.047617 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:02.047741 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:02.047853 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:02.048657 (+ 804us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48830: BlockingRecv error: recv got EOF from 127.0.0.1:48830 (error 108)
Metrics: {"server-negotiator.queue_time_us":88}
I20260619 06:44:02.059203 1174 catalog_manager.cc:1259] Loaded cluster ID: 5ed9ca1a93a74e548be82e21f3a6eb5b
I20260619 06:44:02.059377 1174 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee: loading cluster ID for follower catalog manager: success
I20260619 06:44:02.062486 1174 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee: acquiring CA information for follower catalog manager: success
I20260619 06:44:02.064620 1174 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9c71a2c4563e44f5ad622a705c9207ee: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 06:44:02.393690 1224 catalog_manager.cc:1259] Loaded cluster ID: 5ed9ca1a93a74e548be82e21f3a6eb5b
I20260619 06:44:02.393878 1224 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f: loading cluster ID for follower catalog manager: success
I20260619 06:44:02.396821 1224 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f: acquiring CA information for follower catalog manager: success
I20260619 06:44:02.398713 1224 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 18c2793a69774b249432b530dff9c12f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 06:44:02.573141 1289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:02.565839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48842 (local address 127.10.192.125:39653)
0619 06:44:02.566640 (+ 801us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:02.566647 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:02.566669 (+ 22us) server_negotiation.cc:407] Connection header received
0619 06:44:02.566761 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:02.566767 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:02.566978 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:02.567125 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:44:02.567524 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:02.568830 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:02.570448 (+ 1618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:02.571146 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:02.571265 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:02.571809 (+ 544us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:44:02.572503 (+ 694us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:44:02.572640 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:02.572719 (+ 79us) server_negotiation.cc:299] Negotiation successful
0619 06:44:02.572801 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":675,"thread_start_us":482,"threads_started":1}
I20260619 06:44:02.589197 1295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:02.580030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60580 (local address 127.10.192.124:41673)
0619 06:44:02.583992 (+ 3962us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:02.583996 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:02.584015 (+ 19us) server_negotiation.cc:407] Connection header received
0619 06:44:02.584108 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:02.584112 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:02.584261 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:02.584467 (+ 206us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:44:02.584883 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:02.585604 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:02.586935 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:02.587344 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:02.587484 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:02.588058 (+ 574us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:44:02.588568 (+ 510us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:44:02.588729 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:02.588790 (+ 61us) server_negotiation.cc:299] Negotiation successful
0619 06:44:02.588876 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3859,"thread_start_us":3771,"threads_started":1}
I20260619 06:44:02.616006 1301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:02.595919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56258 (local address 127.10.192.126:34563)
0619 06:44:02.606975 (+ 11056us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:02.606982 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:02.607992 (+ 1010us) server_negotiation.cc:407] Connection header received
0619 06:44:02.608126 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:02.608133 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:02.608357 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:02.608532 (+ 175us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:44:02.609364 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:02.610599 (+ 1235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:02.612938 (+ 2339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:02.613598 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:02.613745 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:02.614431 (+ 686us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:44:02.614928 (+ 497us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:44:02.615028 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:02.615557 (+ 529us) server_negotiation.cc:299] Negotiation successful
0619 06:44:02.615680 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10900,"thread_start_us":11068,"threads_started":1}
I20260619 06:44:02.619902 1295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:02.608314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60596 (local address 127.10.192.124:41673)
0619 06:44:02.608485 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:02.608508 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:02.612193 (+ 3685us) server_negotiation.cc:407] Connection header received
0619 06:44:02.612464 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:02.612469 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:02.612569 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:02.612629 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:44:02.613550 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:02.614682 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:02.616888 (+ 2206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:02.617574 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:02.617672 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:02.619043 (+ 1371us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:44:02.619179 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:44:02.619244 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:02.619499 (+ 255us) server_negotiation.cc:299] Negotiation successful
0619 06:44:02.619591 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260619 06:44:02.621111 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 941
I20260619 06:44:02.621508 1289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:02.596031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48858 (local address 127.10.192.125:39653)
0619 06:44:02.601995 (+ 5964us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:02.602002 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:02.611898 (+ 9896us) server_negotiation.cc:407] Connection header received
0619 06:44:02.612347 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:02.612356 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:02.612463 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:02.612524 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:44:02.613563 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:02.614703 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:02.618400 (+ 3697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:02.619285 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:02.619412 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:02.620704 (+ 1292us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:44:02.620830 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:44:02.620903 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:02.621130 (+ 227us) server_negotiation.cc:299] Negotiation successful
0619 06:44:02.621216 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5806}
I20260619 06:44:02.622232 1003 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:44:02.745895 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 941
I20260619 06:44:02.767506 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 1015
I20260619 06:44:02.768625 1077 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:44:02.876614 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 1015
I20260619 06:44:02.896826 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 1089
I20260619 06:44:02.897922 1151 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:44:03.006299 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 1089
2026-06-19T06:44:03Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (4931 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Jun 19 06:44:03 dist-test-slave-7lz4 krb5kdc[1309](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Jun 19 06:44:03 dist-test-slave-7lz4 krb5kdc[1309](info): set up 2 sockets
Jun 19 06:44:03 dist-test-slave-7lz4 krb5kdc[1309](info): commencing operation
krb5kdc: starting...
W20260619 06:44:04.128340 11009 mini_kdc.cc:121] Time spent starting KDC: real 1.081s user 0.007s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/test-user.keytab.
Jun 19 06:44:04 dist-test-slave-7lz4 krb5kdc[1309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-06-19T06:44:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-06-19T06:44:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.10.192.126@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.126@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
Entry for principal kudu/127.10.192.126 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab.
I20260619 06:44:04.401239 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:40891
--webserver_interface=127.10.192.126
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:43757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:40891,127.10.192.125:40315,127.10.192.124:39285
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260619 06:44:04.756711 1322 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260619 06:44:04.757061 1322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:44:04.757126 1322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:44:04.757211 1322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:44:04.764842 1322 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:44:04.764950 1322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:44:04.765010 1322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:44:04.765064 1322 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:44:04.765126 1322 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:44:04.775507 1322 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:43757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:40891,127.10.192.125:40315,127.10.192.124:39285
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.126.keytab
--principal=kudu/127.10.192.126
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.126:40891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.10.192.126
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:44:04.776959 1322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:44:04.778335 1322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:44:04.790566 1327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:44:04.790498 1328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:44:04.790532 1330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:44:04.791569 1322 server_base.cc:1034] running on GCE node
I20260619 06:44:04.792538 1322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:44:04.794155 1322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:44:04.795447 1322 hybrid_clock.cc:648] HybridClock initialized: now 1781851444795367 us; error 49 us; skew 500 ppm
I20260619 06:44:04.795926 1322 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:44:04 dist-test-slave-7lz4 krb5kdc[1309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851444, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:44:04.799183 1322 init.cc:377] Logged in from keytab as kudu/127.10.192.126@KRBTEST.COM (short username kudu)
I20260619 06:44:04.800859 1322 webserver.cc:460] Webserver started at http://127.10.192.126:37801/ using document root <none> and password file <none>
I20260619 06:44:04.801601 1322 fs_manager.cc:359] Metadata directory not provided
I20260619 06:44:04.801738 1322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:44:04.802078 1322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:44:04.805250 1322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-0/data/instance:
uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f"
format_stamp: "Formatted at 2026-06-19 06:44:04 on dist-test-slave-7lz4"
server_key: "126492d04eac449bc6ff905a95c4d4be"
server_key_iv: "5b2032c2e4299829e89720c3271c33f0"
server_key_version: "encryptionkey@0"
I20260619 06:44:04.806097 1322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-0/wal/instance:
uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f"
format_stamp: "Formatted at 2026-06-19 06:44:04 on dist-test-slave-7lz4"
server_key: "126492d04eac449bc6ff905a95c4d4be"
server_key_iv: "5b2032c2e4299829e89720c3271c33f0"
server_key_version: "encryptionkey@0"
I20260619 06:44:04.811398 1322 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260619 06:44:04.815056 1337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:44:04.816604 1322 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260619 06:44:04.816805 1322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-0/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-0/wal
uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f"
format_stamp: "Formatted at 2026-06-19 06:44:04 on dist-test-slave-7lz4"
server_key: "126492d04eac449bc6ff905a95c4d4be"
server_key_iv: "5b2032c2e4299829e89720c3271c33f0"
server_key_version: "encryptionkey@0"
I20260619 06:44:04.817042 1322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:44:04.837685 1322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:44:04.842084 1322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:44:04.842401 1322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:44:04.862252 1322 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.126:40891
I20260619 06:44:04.862358 1388 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.126:40891 every 8 connection(s)
I20260619 06:44:04.863765 1322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-0/data/info.pb
I20260619 06:44:04.867654 1389 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:44:04.868017 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 1322
I20260619 06:44:04.868219 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-0/wal/instance
I20260619 06:44:04.868754 11009 external_mini_cluster.cc:1428] Setting key 384eb8fa64866eb1ecd5ba70bfeefe94
I20260619 06:44:04.878474 1389 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 06:44:04 dist-test-slave-7lz4 krb5kdc[1309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851444, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.192.125@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.125@KRBTEST.COM" created.
I20260619 06:44:04.902690 1392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:04.882628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51062 (local address 127.10.192.126:40891)
0619 06:44:04.883533 (+ 905us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:04.883556 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:04.884079 (+ 523us) server_negotiation.cc:407] Connection header received
0619 06:44:04.886159 (+ 2080us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:04.886165 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:04.886426 (+ 261us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:04.886641 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:04.888047 (+ 1406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:04.889263 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:04.890678 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:04.891245 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:04.891457 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:04.894861 (+ 3404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:04.894869 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:04.894881 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:04.894910 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:04.898071 (+ 3161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:04.898797 (+ 726us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:04.898806 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:04.898809 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:04.898960 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:04.899357 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:04.899361 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:04.899365 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:04.899951 (+ 586us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:04.900162 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:04.900703 (+ 541us) server_negotiation.cc:299] Negotiation successful
0619 06:44:04.901101 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":415,"threads_started":1}
I20260619 06:44:04.902719 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:04.882644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:40891 (local address 127.0.0.1:51062)
0619 06:44:04.883913 (+ 1269us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:04.883954 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0619 06:44:04.885764 (+ 1810us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:44:04.886651 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:44:04.886658 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:44:04.887414 (+ 756us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:44:04.887835 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:04.887855 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:04.889432 (+ 1577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:04.889437 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:04.890535 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:04.890547 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:04.891488 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:04.891495 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:04.891715 (+ 220us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:04.892413 (+ 698us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:44:04.892436 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:44:04.894623 (+ 2187us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:44:04.898206 (+ 3583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:04.898218 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:04.898231 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:04.898650 (+ 419us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:04.899070 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:04.899076 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:04.899080 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:04.899243 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:04.900093 (+ 850us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:44:04.900103 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:44:04.900329 (+ 226us) client_negotiation.cc:769] Sending connection context
0619 06:44:04.900579 (+ 250us) client_negotiation.cc:240] Negotiation successful
0619 06:44:04.901211 (+ 632us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1022,"mutex_wait_us":149,"spinlock_wait_cycles":38144,"thread_start_us":781,"threads_started":1}
I20260619 06:44:04.906556 1389 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } has no permanent_uuid. Determining permanent_uuid...
I20260619 06:44:04.907923 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:04.907424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:40315 (local address 127.0.0.1:47420)
0619 06:44:04.907596 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:04.907797 (+ 201us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:40315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260619 06:44:04.908262 1338 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.192.125:40315: connect: Connection refused (error 111)
I20260619 06:44:04.909850 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:04.909489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:40315 (local address 127.0.0.1:47424)
0619 06:44:04.909651 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:04.909723 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:40315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260619 06:44:04.910197 1389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.125:40315: Network error: Client connection negotiation failed: client connection to 127.10.192.125:40315: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.125 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.125.keytab.
Entry for principal kudu/127.10.192.125 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.125.keytab.
I20260619 06:44:04.930539 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.125:40315
--webserver_interface=127.10.192.125
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.125.keytab
--principal=kudu/127.10.192.125
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:43757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:40891,127.10.192.125:40315,127.10.192.124:39285
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:44:04.959589 1389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } attempt: 1
I20260619 06:44:04.960949 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:04.960405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:40315 (local address 127.0.0.1:47438)
0619 06:44:04.960615 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:04.960781 (+ 166us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:40315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260619 06:44:04.962181 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:04.961787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:40315 (local address 127.0.0.1:47440)
0619 06:44:04.961975 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:04.962045 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:40315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
W20260619 06:44:04.962442 1389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.125:40315: Network error: Client connection negotiation failed: client connection to 127.10.192.125:40315: connect: Connection refused (error 111)
I20260619 06:44:05.030746 1389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } attempt: 2
I20260619 06:44:05.031989 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.031456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:40315 (local address 127.0.0.1:47448)
0619 06:44:05.031747 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.031853 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:40315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260619 06:44:05.033234 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.032802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:40315 (local address 127.0.0.1:47452)
0619 06:44:05.033004 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.033075 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:40315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260619 06:44:05.033505 1389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.125:40315: Network error: Client connection negotiation failed: client connection to 127.10.192.125:40315: connect: Connection refused (error 111)
I20260619 06:44:05.124759 1389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } attempt: 3
I20260619 06:44:05.125998 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.125577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:40315 (local address 127.0.0.1:47454)
0619 06:44:05.125773 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.125868 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:40315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260619 06:44:05.127053 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.126741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:40315 (local address 127.0.0.1:47456)
0619 06:44:05.126874 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.126933 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:40315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260619 06:44:05.127308 1389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.125:40315: Network error: Client connection negotiation failed: client connection to 127.10.192.125:40315: connect: Connection refused (error 111)
W20260619 06:44:05.267015 1396 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260619 06:44:05.267345 1396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:44:05.267500 1396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:44:05.267637 1396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260619 06:44:05.270605 1389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } attempt: 4
I20260619 06:44:05.272115 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.271408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:40315 (local address 127.0.0.1:47462)
0619 06:44:05.271860 (+ 452us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.271962 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:40315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":204}
I20260619 06:44:05.273320 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.272896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:40315 (local address 127.0.0.1:47478)
0619 06:44:05.273076 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.273173 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.125:40315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260619 06:44:05.273550 1389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.125:40315: Network error: Client connection negotiation failed: client connection to 127.10.192.125:40315: connect: Connection refused (error 111)
W20260619 06:44:05.275699 1396 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:44:05.275789 1396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:44:05.275921 1396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:44:05.276006 1396 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:44:05.276104 1396 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:44:05.286497 1396 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:43757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:40891,127.10.192.125:40315,127.10.192.124:39285
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.125.keytab
--principal=kudu/127.10.192.125
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.125:40315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.10.192.125
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:44:05.287973 1396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:44:05.289351 1396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:44:05.301630 1404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:44:05.301604 1401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:44:05.301755 1402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:44:05.302342 1396 server_base.cc:1034] running on GCE node
I20260619 06:44:05.303186 1396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:44:05.304708 1396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:44:05.305939 1396 hybrid_clock.cc:648] HybridClock initialized: now 1781851445305851 us; error 56 us; skew 500 ppm
I20260619 06:44:05.306294 1396 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:44:05 dist-test-slave-7lz4 krb5kdc[1309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851445, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.125@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:44:05.309523 1396 init.cc:377] Logged in from keytab as kudu/127.10.192.125@KRBTEST.COM (short username kudu)
I20260619 06:44:05.310962 1396 webserver.cc:460] Webserver started at http://127.10.192.125:37913/ using document root <none> and password file <none>
I20260619 06:44:05.311779 1396 fs_manager.cc:359] Metadata directory not provided
I20260619 06:44:05.311934 1396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:44:05.312279 1396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:44:05.315413 1396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-1/data/instance:
uuid: "5bceddb4cfb2469fbb5db63b6ad55995"
format_stamp: "Formatted at 2026-06-19 06:44:05 on dist-test-slave-7lz4"
server_key: "f22eab37d14066f8d2b6fec878f92922"
server_key_iv: "52b71ddc12f9b163297a88ce66ba64fd"
server_key_version: "encryptionkey@0"
I20260619 06:44:05.316318 1396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-1/wal/instance:
uuid: "5bceddb4cfb2469fbb5db63b6ad55995"
format_stamp: "Formatted at 2026-06-19 06:44:05 on dist-test-slave-7lz4"
server_key: "f22eab37d14066f8d2b6fec878f92922"
server_key_iv: "52b71ddc12f9b163297a88ce66ba64fd"
server_key_version: "encryptionkey@0"
I20260619 06:44:05.321820 1396 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260619 06:44:05.325407 1411 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:44:05.326750 1396 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260619 06:44:05.326936 1396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-1/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-1/wal
uuid: "5bceddb4cfb2469fbb5db63b6ad55995"
format_stamp: "Formatted at 2026-06-19 06:44:05 on dist-test-slave-7lz4"
server_key: "f22eab37d14066f8d2b6fec878f92922"
server_key_iv: "52b71ddc12f9b163297a88ce66ba64fd"
server_key_version: "encryptionkey@0"
I20260619 06:44:05.327167 1396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:44:05.347200 1396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:44:05.351814 1396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:44:05.352111 1396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:44:05.371338 1396 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.125:40315
I20260619 06:44:05.371363 1462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.125:40315 every 8 connection(s)
I20260619 06:44:05.372949 1396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-1/data/info.pb
I20260619 06:44:05.377043 1463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:44:05.377079 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 1396
I20260619 06:44:05.377282 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-1/wal/instance
I20260619 06:44:05.377774 11009 external_mini_cluster.cc:1428] Setting key d804811dfb6a4cd2f89cd4e252d30308
I20260619 06:44:05.384029 1463 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 06:44:05 dist-test-slave-7lz4 krb5kdc[1309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851445, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.125@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
WARNING: no policy specified for kudu/127.10.192.124@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.10.192.124@KRBTEST.COM" created.
I20260619 06:44:05.407115 1392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.387313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51078 (local address 127.10.192.126:40891)
0619 06:44:05.387555 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:05.387564 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:05.388817 (+ 1253us) server_negotiation.cc:407] Connection header received
0619 06:44:05.390791 (+ 1974us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:05.390801 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:05.390902 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:05.391023 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:05.392653 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.393811 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.395411 (+ 1600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.396267 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.396435 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:05.400415 (+ 3980us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:05.400424 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:05.400429 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:05.400483 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:05.403688 (+ 3205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:05.404584 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:05.404593 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:05.404599 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:05.404762 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:05.405305 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:05.405308 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:05.405310 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:05.405600 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:05.405713 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:05.406695 (+ 982us) server_negotiation.cc:299] Negotiation successful
0619 06:44:05.406887 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260619 06:44:05.408751 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.387801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:40891 (local address 127.0.0.1:51078)
0619 06:44:05.388619 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.388666 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0619 06:44:05.390482 (+ 1816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:44:05.391229 (+ 747us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:44:05.391237 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:44:05.391893 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:44:05.392464 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:05.392481 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.393986 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.393990 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:05.395234 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:05.395246 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.396507 (+ 1261us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.396512 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:05.396765 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:05.397499 (+ 734us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:44:05.397523 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:44:05.400126 (+ 2603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:44:05.403836 (+ 3710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:05.403843 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:05.403858 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:05.404431 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:05.404901 (+ 470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:05.404907 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:05.404911 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:05.405189 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:05.405748 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:44:05.405759 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:44:05.406284 (+ 525us) client_negotiation.cc:769] Sending connection context
0619 06:44:05.406610 (+ 326us) client_negotiation.cc:240] Negotiation successful
0619 06:44:05.407223 (+ 613us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"thread_start_us":367,"threads_started":1}
I20260619 06:44:05.410579 1463 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 06:44:05 dist-test-slave-7lz4 krb5kdc[1309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851445, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.125@KRBTEST.COM for kudu/127.10.192.125@KRBTEST.COM
I20260619 06:44:05.425554 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.411390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:40315 (local address 127.0.0.1:47490)
0619 06:44:05.411568 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.411588 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0619 06:44:05.411745 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:44:05.412785 (+ 1040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:44:05.412790 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:44:05.413247 (+ 457us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:44:05.413389 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:05.413397 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.414769 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.414777 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:05.415624 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:05.415697 (+ 73us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.416505 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.416509 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:05.416726 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:05.417353 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:44:05.417370 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:44:05.419597 (+ 2227us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:44:05.423005 (+ 3408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:05.423010 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:05.423014 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:05.423371 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:05.423800 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:05.423804 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:05.423808 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:05.423953 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:05.424545 (+ 592us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:44:05.424554 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:44:05.424697 (+ 143us) client_negotiation.cc:769] Sending connection context
0619 06:44:05.424843 (+ 146us) client_negotiation.cc:240] Negotiation successful
0619 06:44:05.425123 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":59}
I20260619 06:44:05.425597 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.411733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47490 (local address 127.10.192.125:40315)
0619 06:44:05.412377 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:05.412384 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:05.412408 (+ 24us) server_negotiation.cc:407] Connection header received
0619 06:44:05.412450 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:05.412455 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:05.412639 (+ 184us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:05.412804 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:05.413557 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.414635 (+ 1078us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.415827 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.416362 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.416496 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:05.419881 (+ 3385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:05.419898 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:05.419922 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:05.419951 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:05.422858 (+ 2907us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:05.423514 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:05.423521 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:05.423523 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:05.423675 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:05.424064 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:05.424068 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:05.424072 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:05.424420 (+ 348us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:05.424647 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:05.425003 (+ 356us) server_negotiation.cc:299] Negotiation successful
0619 06:44:05.425218 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":492,"thread_start_us":359,"threads_started":1}
I20260619 06:44:05.428383 1463 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } has no permanent_uuid. Determining permanent_uuid...
I20260619 06:44:05.429687 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.429097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:48988)
0619 06:44:05.429311 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.429470 (+ 159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
W20260619 06:44:05.429953 1415 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
I20260619 06:44:05.431622 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.431252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:48996)
0619 06:44:05.431408 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.431486 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260619 06:44:05.432014 1463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:39285: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.10.192.124 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.124.keytab.
Entry for principal kudu/127.10.192.124 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.124.keytab.
I20260619 06:44:05.438746 11009 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskx_grPe/build/asan/bin/kudu
/tmp/dist-test-taskx_grPe/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.124:39285
--webserver_interface=127.10.192.124
--webserver_port=0
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.124.keytab
--principal=kudu/127.10.192.124
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.10.192.84:43757
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.10.192.126:40891,127.10.192.125:40315,127.10.192.124:39285
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260619 06:44:05.481379 1463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } attempt: 1
I20260619 06:44:05.482638 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.482183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:49002)
0619 06:44:05.482382 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.482489 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260619 06:44:05.483619 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.483291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:49008)
0619 06:44:05.483453 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.483523 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260619 06:44:05.483891 1463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:39285: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
I20260619 06:44:05.552145 1463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } attempt: 2
I20260619 06:44:05.553516 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.552976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:49020)
0619 06:44:05.553208 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.553326 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86}
I20260619 06:44:05.554656 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.554266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:49024)
0619 06:44:05.554444 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.554519 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260619 06:44:05.554924 1463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:39285: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
I20260619 06:44:05.572858 1389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } attempt: 5
Jun 19 06:44:05 dist-test-slave-7lz4 krb5kdc[1309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851444, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for kudu/127.10.192.125@KRBTEST.COM
I20260619 06:44:05.587414 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.573720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47500 (local address 127.10.192.125:40315)
0619 06:44:05.573921 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:05.573927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:05.573952 (+ 25us) server_negotiation.cc:407] Connection header received
0619 06:44:05.574125 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:05.574130 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:05.574215 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:05.574338 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:05.575133 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.576268 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.577469 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.578226 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.578365 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:05.581803 (+ 3438us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:05.581808 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:05.581811 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:05.581844 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:05.584570 (+ 2726us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:05.585518 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:05.585522 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:05.585525 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:05.585651 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:05.586178 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:05.586183 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:05.586186 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:05.586460 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:05.586573 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:05.587035 (+ 462us) server_negotiation.cc:299] Negotiation successful
0619 06:44:05.587201 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260619 06:44:05.587711 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.573626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:40315 (local address 127.0.0.1:47500)
0619 06:44:05.573845 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.573867 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0619 06:44:05.573981 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:44:05.574390 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:44:05.574394 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:44:05.574783 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:44:05.574963 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:05.574972 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.576428 (+ 1456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.576432 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:05.577312 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:05.577324 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.578387 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.578391 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:05.578539 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:05.579215 (+ 676us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:44:05.579234 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:44:05.581572 (+ 2338us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:44:05.584722 (+ 3150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:05.584731 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:05.584737 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:05.585385 (+ 648us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:05.585814 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:05.585830 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:05.585835 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:05.586055 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:05.586585 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:44:05.586590 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:44:05.586769 (+ 179us) client_negotiation.cc:769] Sending connection context
0619 06:44:05.586945 (+ 176us) client_negotiation.cc:240] Negotiation successful
0619 06:44:05.587237 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83}
I20260619 06:44:05.588809 1389 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } has no permanent_uuid. Determining permanent_uuid...
I20260619 06:44:05.589926 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.589473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:49032)
0619 06:44:05.589657 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.589759 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260619 06:44:05.590925 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.590541 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:49044)
0619 06:44:05.590702 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.590786 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260619 06:44:05.591147 1389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:39285: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
I20260619 06:44:05.642426 1389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } attempt: 1
I20260619 06:44:05.643827 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.643202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:49050)
0619 06:44:05.643453 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.643566 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260619 06:44:05.644989 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.644599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:49054)
0619 06:44:05.644756 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.644854 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260619 06:44:05.645252 1389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:39285: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
I20260619 06:44:05.646198 1463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } attempt: 3
I20260619 06:44:05.647210 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.646773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:49056)
0619 06:44:05.646964 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.647067 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260619 06:44:05.648413 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.647991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:49070)
0619 06:44:05.648213 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.648291 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136}
W20260619 06:44:05.648649 1463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:39285: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
I20260619 06:44:05.713510 1389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } attempt: 2
I20260619 06:44:05.714926 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.714320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:49082)
0619 06:44:05.714585 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.714698 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260619 06:44:05.716059 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.715604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:49094)
0619 06:44:05.715806 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.715898 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
W20260619 06:44:05.716320 1389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:39285: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
W20260619 06:44:05.779390 1470 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260619 06:44:05.779796 1470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260619 06:44:05.779942 1470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260619 06:44:05.780067 1470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260619 06:44:05.787459 1470 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260619 06:44:05.787554 1470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260619 06:44:05.787688 1470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260619 06:44:05.787767 1470 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260619 06:44:05.787882 1470 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260619 06:44:05.791872 1463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } attempt: 4
I20260619 06:44:05.793321 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.792583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:49100)
0619 06:44:05.792863 (+ 280us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.792958 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260619 06:44:05.794329 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.793998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:49102)
0619 06:44:05.794150 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.794229 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260619 06:44:05.794552 1463 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:39285: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
I20260619 06:44:05.798622 1470 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.10.192.84:43757
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.10.192.126:40891,127.10.192.125:40315,127.10.192.124:39285
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/krb5kdc/kudu_127.10.192.124.keytab
--principal=kudu/127.10.192.124
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.10.192.124:39285
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.10.192.124
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 19 Jun 2026 05:51:38 UTC on ccycloud.quasar-yggyfi.root.comops.site
build id 4455158
ASAN enabled
I20260619 06:44:05.800094 1470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260619 06:44:05.801465 1470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260619 06:44:05.813510 1475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:44:05.814535 1476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260619 06:44:05.814571 1478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260619 06:44:05.815436 1470 server_base.cc:1034] running on GCE node
I20260619 06:44:05.816370 1470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260619 06:44:05.817909 1470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260619 06:44:05.819164 1470 hybrid_clock.cc:648] HybridClock initialized: now 1781851445819100 us; error 55 us; skew 500 ppm
I20260619 06:44:05.819520 1470 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Jun 19 06:44:05 dist-test-slave-7lz4 krb5kdc[1309](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851445, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.124@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260619 06:44:05.822570 1389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } attempt: 3
I20260619 06:44:05.822956 1470 init.cc:377] Logged in from keytab as kudu/127.10.192.124@KRBTEST.COM (short username kudu)
I20260619 06:44:05.823956 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.823207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:49106)
0619 06:44:05.823492 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.823610 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260619 06:44:05.825130 1470 webserver.cc:460] Webserver started at http://127.10.192.124:45863/ using document root <none> and password file <none>
I20260619 06:44:05.825156 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.824621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:49122)
0619 06:44:05.824879 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.825000 (+ 121us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115}
W20260619 06:44:05.825440 1389 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.10.192.124:39285: Network error: Client connection negotiation failed: client connection to 127.10.192.124:39285: connect: Connection refused (error 111)
I20260619 06:44:05.825971 1470 fs_manager.cc:359] Metadata directory not provided
I20260619 06:44:05.826102 1470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260619 06:44:05.826445 1470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260619 06:44:05.829595 1470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-2/data/instance:
uuid: "31fa95c56e3749588fadfef72f119e4a"
format_stamp: "Formatted at 2026-06-19 06:44:05 on dist-test-slave-7lz4"
server_key: "d5e5a2cc1f0db28f57f3394c69569e32"
server_key_iv: "0d3b7d4d2d5805e30d342841692ba53d"
server_key_version: "encryptionkey@0"
I20260619 06:44:05.830456 1470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-2/wal/instance:
uuid: "31fa95c56e3749588fadfef72f119e4a"
format_stamp: "Formatted at 2026-06-19 06:44:05 on dist-test-slave-7lz4"
server_key: "d5e5a2cc1f0db28f57f3394c69569e32"
server_key_iv: "0d3b7d4d2d5805e30d342841692ba53d"
server_key_version: "encryptionkey@0"
I20260619 06:44:05.836077 1470 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260619 06:44:05.839814 1485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260619 06:44:05.841168 1470 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260619 06:44:05.841370 1470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-2/data,/tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-2/wal
uuid: "31fa95c56e3749588fadfef72f119e4a"
format_stamp: "Formatted at 2026-06-19 06:44:05 on dist-test-slave-7lz4"
server_key: "d5e5a2cc1f0db28f57f3394c69569e32"
server_key_iv: "0d3b7d4d2d5805e30d342841692ba53d"
server_key_version: "encryptionkey@0"
I20260619 06:44:05.841598 1470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260619 06:44:05.857342 1470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260619 06:44:05.861786 1470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260619 06:44:05.862109 1470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260619 06:44:05.881212 1470 rpc_server.cc:307] RPC server started. Bound to: 127.10.192.124:39285
I20260619 06:44:05.881219 1536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.10.192.124:39285 every 8 connection(s)
I20260619 06:44:05.882654 1470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-2/data/info.pb
I20260619 06:44:05.884454 11009 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskx_grPe/build/asan/bin/kudu as pid 1470
I20260619 06:44:05.884673 11009 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskx_grPe/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1781851080573990-11009-0/minicluster-data/master-2/wal/instance
I20260619 06:44:05.885084 11009 external_mini_cluster.cc:1428] Setting key ffcf88e6352798a57dd91366437cb418
I20260619 06:44:05.887104 1537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260619 06:44:05.895608 1537 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 06:44:05 dist-test-slave-7lz4 krb5kdc[1309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.124@KRBTEST.COM
Jun 19 06:44:05 dist-test-slave-7lz4 krb5kdc[1309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851445, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.124@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
I20260619 06:44:05.909435 1540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.886849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49126 (local address 127.10.192.124:39285)
0619 06:44:05.887684 (+ 835us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:05.887705 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:05.887749 (+ 44us) server_negotiation.cc:407] Connection header received
0619 06:44:05.889384 (+ 1635us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:05.889405 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:05.889834 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:05.890171 (+ 337us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:05.892167 (+ 1996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.893517 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.895278 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.896096 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.896290 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:05.901138 (+ 4848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:05.901148 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:05.901164 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:05.901226 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:05.904889 (+ 3663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:05.905726 (+ 837us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:05.905736 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:05.905745 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:05.906041 (+ 296us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:05.906471 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:05.906477 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:05.906480 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:05.907196 (+ 716us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:05.907424 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:05.907992 (+ 568us) server_negotiation.cc:299] Negotiation successful
0619 06:44:05.908395 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":583,"spinlock_wait_cycles":19200,"thread_start_us":383,"threads_started":1}
I20260619 06:44:05.915022 1392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.898831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51088 (local address 127.10.192.126:40891)
0619 06:44:05.899113 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:05.899123 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:05.899872 (+ 749us) server_negotiation.cc:407] Connection header received
0619 06:44:05.900088 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:05.900095 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:05.900185 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:05.900291 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:05.901542 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.902232 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.904345 (+ 2113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.904776 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.904879 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:05.908767 (+ 3888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:05.908773 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:05.908776 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:05.908811 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:05.911516 (+ 2705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:05.912907 (+ 1391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:05.912913 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:05.912918 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:05.913083 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:05.913499 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:05.913502 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:05.913504 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:05.913764 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:05.913936 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:05.914396 (+ 460us) server_negotiation.cc:299] Negotiation successful
0619 06:44:05.914617 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260619 06:44:05.915041 1541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.898812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.126:40891 (local address 127.0.0.1:51088)
0619 06:44:05.899749 (+ 937us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.899784 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0619 06:44:05.899957 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:44:05.900366 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:44:05.900371 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:44:05.900971 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:44:05.901380 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:05.901395 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.902409 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.902416 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:05.904174 (+ 1758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:05.904189 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.904970 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.904978 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:05.905142 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:05.905789 (+ 647us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:44:05.905809 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:44:05.908531 (+ 2722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:44:05.911679 (+ 3148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:05.911692 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:05.911701 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:05.912240 (+ 539us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:05.913221 (+ 981us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:05.913226 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:05.913230 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:05.913368 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:05.913904 (+ 536us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:44:05.913912 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:44:05.914105 (+ 193us) client_negotiation.cc:769] Sending connection context
0619 06:44:05.914283 (+ 178us) client_negotiation.cc:240] Negotiation successful
0619 06:44:05.914608 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":506,"threads_started":1}
I20260619 06:44:05.916491 1537 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 06:44:05 dist-test-slave-7lz4 krb5kdc[1309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.126@KRBTEST.COM
Jun 19 06:44:05 dist-test-slave-7lz4 krb5kdc[1309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851445, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.124@KRBTEST.COM for kudu/127.10.192.125@KRBTEST.COM
I20260619 06:44:05.929163 1542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.912492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51096 (local address 127.10.192.126:40891)
0619 06:44:05.913015 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:05.913020 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:05.913039 (+ 19us) server_negotiation.cc:407] Connection header received
0619 06:44:05.913097 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:05.913100 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:05.913154 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:05.913275 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:05.914500 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.915621 (+ 1121us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.917104 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.917680 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.917801 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:05.922882 (+ 5081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:05.922887 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:05.922891 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:05.922922 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:05.926110 (+ 3188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:05.926932 (+ 822us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:05.926937 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:05.926939 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:05.927067 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:05.927488 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:05.927491 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:05.927493 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:05.927860 (+ 367us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:05.928060 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:05.928470 (+ 410us) server_negotiation.cc:299] Negotiation successful
0619 06:44:05.928749 (+ 279us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":217,"threads_started":1}
I20260619 06:44:05.931089 1541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.917315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.125:40315 (local address 127.0.0.1:47504)
0619 06:44:05.917514 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.917532 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0619 06:44:05.917630 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:44:05.917992 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:44:05.917995 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:44:05.918310 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:44:05.918452 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:05.918459 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.919414 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.919421 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:05.920983 (+ 1562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:05.921001 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.922001 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.922007 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:05.922238 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:05.922799 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:44:05.922826 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:44:05.924958 (+ 2132us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:44:05.928391 (+ 3433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:05.928396 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:05.928399 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:05.928934 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:05.929315 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:05.929319 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:05.929323 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:05.929467 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:05.930047 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:44:05.930054 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:44:05.930247 (+ 193us) client_negotiation.cc:769] Sending connection context
0619 06:44:05.930422 (+ 175us) client_negotiation.cc:240] Negotiation successful
0619 06:44:05.930716 (+ 294us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75}
I20260619 06:44:05.931185 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.917327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47504 (local address 127.10.192.125:40315)
0619 06:44:05.917543 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:05.917548 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:05.917578 (+ 30us) server_negotiation.cc:407] Connection header received
0619 06:44:05.917768 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:05.917776 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:05.917856 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:05.917962 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:05.918581 (+ 619us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.919266 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.921141 (+ 1875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.921847 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.921944 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:05.925150 (+ 3206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:05.925155 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:05.925158 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:05.925190 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:05.928224 (+ 3034us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:05.929049 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:05.929053 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:05.929055 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:05.929195 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:05.929576 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:05.929584 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:05.929590 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:05.929890 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:05.930051 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:05.930534 (+ 483us) server_negotiation.cc:299] Negotiation successful
0619 06:44:05.930789 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99}
I20260619 06:44:05.932690 1537 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } has no permanent_uuid. Determining permanent_uuid...
Jun 19 06:44:05 dist-test-slave-7lz4 krb5kdc[1309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.192.125@KRBTEST.COM
Jun 19 06:44:05 dist-test-slave-7lz4 krb5kdc[1309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851445, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.124@KRBTEST.COM for kudu/127.10.192.124@KRBTEST.COM
I20260619 06:44:05.947432 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.930965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47520 (local address 127.10.192.125:40315)
0619 06:44:05.931488 (+ 523us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:05.931492 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:05.931504 (+ 12us) server_negotiation.cc:407] Connection header received
0619 06:44:05.931539 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:05.931542 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:05.931625 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:05.931764 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:05.933326 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.934362 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.935840 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.936355 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.936446 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:05.941553 (+ 5107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:05.941561 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:05.941566 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:05.941608 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:05.944400 (+ 2792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:05.945245 (+ 845us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:05.945252 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:05.945270 (+ 18us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:05.945459 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:05.945859 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:05.945864 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:05.945868 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:05.946272 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:05.946565 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:05.946812 (+ 247us) server_negotiation.cc:299] Negotiation successful
0619 06:44:05.947024 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":420,"thread_start_us":794,"threads_started":1}
I20260619 06:44:05.948129 1541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.933537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:49136)
0619 06:44:05.933700 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:05.933715 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0619 06:44:05.933827 (+ 112us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:44:05.934312 (+ 485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:44:05.934315 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:44:05.934784 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:44:05.934974 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:05.934984 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.936070 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.936074 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:05.937220 (+ 1146us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:05.937236 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.937950 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.937957 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:05.938192 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:05.938793 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:44:05.938835 (+ 42us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:44:05.941875 (+ 3040us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:44:05.945292 (+ 3417us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:05.945296 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:05.945304 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:05.945860 (+ 556us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:05.946263 (+ 403us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:05.946267 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:05.946270 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:05.946434 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:05.947017 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:44:05.947021 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:44:05.947227 (+ 206us) client_negotiation.cc:769] Sending connection context
0619 06:44:05.947381 (+ 154us) client_negotiation.cc:240] Negotiation successful
0619 06:44:05.947731 (+ 350us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":68}
I20260619 06:44:05.948377 1540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:05.933883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49136 (local address 127.10.192.124:39285)
0619 06:44:05.934051 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:05.934056 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:05.934073 (+ 17us) server_negotiation.cc:407] Connection header received
0619 06:44:05.934120 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:05.934125 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:05.934191 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:05.934282 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:05.935111 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.935947 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.937362 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:05.937774 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:05.937866 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:05.942052 (+ 4186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:05.942057 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:05.942060 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:05.942089 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:05.945144 (+ 3055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:05.945982 (+ 838us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:05.945986 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:05.945988 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:05.946130 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:05.946545 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:05.946550 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:05.946554 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:05.946894 (+ 340us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:05.947036 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:05.947481 (+ 445us) server_negotiation.cc:299] Negotiation successful
0619 06:44:05.947958 (+ 477us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":155,"server-negotiator.queue_time_us":57}
I20260619 06:44:05.952677 11009 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260619 06:44:05.953754 1537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a: Bootstrap starting.
I20260619 06:44:05.957127 1537 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a: Neither blocks nor log segments found. Creating new log.
I20260619 06:44:05.958253 1537 log.cc:824] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a: Log is configured to *not* fsync() on all Append() calls
I20260619 06:44:05.955163 1364 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51096
I20260619 06:44:05.961311 1537 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a: No bootstrap required, opened a new log
I20260619 06:44:05.968549 1537 raft_consensus.cc:348] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } } peers { permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } } peers { permanent_uuid: "31fa95c56e3749588fadfef72f119e4a" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } }
I20260619 06:44:05.968883 1537 raft_consensus.cc:729] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31fa95c56e3749588fadfef72f119e4a, State: Initialized, Role: FOLLOWER
I20260619 06:44:05.969374 1537 consensus_queue.cc:260] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } } peers { permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } } peers { permanent_uuid: "31fa95c56e3749588fadfef72f119e4a" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } }
I20260619 06:44:05.970388 1545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } } peers { permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } } peers { permanent_uuid: "31fa95c56e3749588fadfef72f119e4a" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } } }
I20260619 06:44:05.970866 1545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:44:05.971359 1537 sys_catalog.cc:564] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a [sys.catalog]: configured and running, proceeding with master startup.
W20260619 06:44:05.986651 1556 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260619 06:44:05.986819 1556 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260619 06:44:05.978871 1470 master_runner.cc:186] Error getting master registration for 127.10.192.126:40891: OK, instance_id { permanent_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" instance_seqno: 1781851444856487 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 06:44:05.989212 1470 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260619 06:44:06.002772 1389 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } attempt: 4
Jun 19 06:44:06 dist-test-slave-7lz4 krb5kdc[1309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851444, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.126@KRBTEST.COM for kudu/127.10.192.124@KRBTEST.COM
I20260619 06:44:06.020294 1393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:06.003670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:49144)
0619 06:44:06.003981 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:06.004000 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0619 06:44:06.004136 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:44:06.004594 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:44:06.004599 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:44:06.005137 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:44:06.005414 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:06.005426 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.006500 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.006507 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:06.008070 (+ 1563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:06.008086 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.009154 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.009161 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:06.009371 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:06.010078 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:44:06.010101 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:44:06.012912 (+ 2811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:44:06.017261 (+ 4349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:06.017269 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:06.017275 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:06.017862 (+ 587us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:06.018297 (+ 435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:06.018302 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:06.018305 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:06.018478 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:06.019158 (+ 680us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:44:06.019162 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:44:06.019371 (+ 209us) client_negotiation.cc:769] Sending connection context
0619 06:44:06.019523 (+ 152us) client_negotiation.cc:240] Negotiation successful
0619 06:44:06.019858 (+ 335us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":181}
I20260619 06:44:06.020310 1540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:06.003750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49144 (local address 127.10.192.124:39285)
0619 06:44:06.003985 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.003994 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.004063 (+ 69us) server_negotiation.cc:407] Connection header received
0619 06:44:06.004307 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.004316 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.004421 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.004543 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:06.005593 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.006341 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.008232 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.008958 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.009106 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:06.013127 (+ 4021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:06.013134 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:06.013140 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:06.013188 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:06.017076 (+ 3888us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:06.018012 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:06.018018 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:06.018022 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:06.018168 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:06.018609 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:06.018615 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:06.018618 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:06.019039 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:06.019208 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:06.019689 (+ 481us) server_negotiation.cc:299] Negotiation successful
0619 06:44:06.019940 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260619 06:44:06.025182 1389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f: Bootstrap starting.
I20260619 06:44:06.028534 1389 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f: Neither blocks nor log segments found. Creating new log.
I20260619 06:44:06.029621 1389 log.cc:824] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f: Log is configured to *not* fsync() on all Append() calls
I20260619 06:44:06.032721 1389 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f: No bootstrap required, opened a new log
I20260619 06:44:06.037933 1389 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } } peers { permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } } peers { permanent_uuid: "31fa95c56e3749588fadfef72f119e4a" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } }
I20260619 06:44:06.038300 1389 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1da52e8fb40b41b5b3d1dfe1aad6f65f, State: Initialized, Role: FOLLOWER
I20260619 06:44:06.038761 1389 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } } peers { permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } } peers { permanent_uuid: "31fa95c56e3749588fadfef72f119e4a" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } }
I20260619 06:44:06.039712 1559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } } peers { permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } } peers { permanent_uuid: "31fa95c56e3749588fadfef72f119e4a" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } } }
I20260619 06:44:06.040086 1559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:44:06.040902 1389 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:44:06.041033 1364 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260619 06:44:06.041263 1364 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:44:06.044848 1364 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } } peers { permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } } peers { permanent_uuid: "31fa95c56e3749588fadfef72f119e4a" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } }
I20260619 06:44:06.047766 1364 leader_election.cc:288] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [CANDIDATE]: Term 1 election: Requested vote from peers 5bceddb4cfb2469fbb5db63b6ad55995 (127.10.192.125:40315), 31fa95c56e3749588fadfef72f119e4a (127.10.192.124:39285)
I20260619 06:44:06.048195 1512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "31fa95c56e3749588fadfef72f119e4a"
I20260619 06:44:06.048851 1512 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:44:06.055620 1512 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da52e8fb40b41b5b3d1dfe1aad6f65f in term 1.
I20260619 06:44:06.057027 1341 leader_election.cc:302] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1da52e8fb40b41b5b3d1dfe1aad6f65f, 31fa95c56e3749588fadfef72f119e4a; no voters:
I20260619 06:44:06.057593 1559 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [term 1 FOLLOWER]: Leader election won for term 1
I20260619 06:44:06.059947 1559 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [term 1 LEADER]: Becoming Leader. State: Replica: 1da52e8fb40b41b5b3d1dfe1aad6f65f, State: Running, Role: LEADER
I20260619 06:44:06.060621 1559 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } } peers { permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } } peers { permanent_uuid: "31fa95c56e3749588fadfef72f119e4a" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } }
I20260619 06:44:06.069495 1570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1da52e8fb40b41b5b3d1dfe1aad6f65f. Latest consensus state: current_term: 1 leader_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } } peers { permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } } peers { permanent_uuid: "31fa95c56e3749588fadfef72f119e4a" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } } }
I20260619 06:44:06.070044 1570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [sys.catalog]: This master's current role is: LEADER
I20260619 06:44:06.075294 1575 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260619 06:44:06.087013 1575 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260619 06:44:06.093745 1463 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } attempt: 5
W20260619 06:44:06.095434 1343 tablet.cc:2369] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260619 06:44:06.087935 1322 master_runner.cc:186] Error getting master registration for 127.10.192.125:40315: OK, instance_id { permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" instance_seqno: 1781851445366080 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260619 06:44:06.101799 1322 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260619 06:44:06.114452 1491 tablet.cc:2369] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
Jun 19 06:44:06 dist-test-slave-7lz4 krb5kdc[1309](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1781851445, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.192.125@KRBTEST.COM for kudu/127.10.192.124@KRBTEST.COM
I20260619 06:44:06.134861 1542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:06.089759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51108 (local address 127.10.192.126:40891)
0619 06:44:06.090217 (+ 458us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.090227 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.115768 (+ 25541us) server_negotiation.cc:407] Connection header received
0619 06:44:06.115964 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.115974 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.116083 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.116199 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:06.118672 (+ 2473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.119785 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.122105 (+ 2320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.123153 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.123261 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:06.126960 (+ 3699us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:06.126967 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:06.126973 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:06.127019 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:06.131057 (+ 4038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:06.132218 (+ 1161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:06.132224 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:06.132228 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:06.132401 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:06.132961 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:06.132967 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:06.132970 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:06.133360 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:06.133645 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:06.134188 (+ 543us) server_negotiation.cc:299] Negotiation successful
0619 06:44:06.134457 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258}
I20260619 06:44:06.136951 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:06.090723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47534 (local address 127.10.192.125:40315)
0619 06:44:06.090947 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.090956 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.112339 (+ 21383us) server_negotiation.cc:407] Connection header received
0619 06:44:06.112633 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.112640 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.112729 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.112831 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:06.118647 (+ 5816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.119873 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.122076 (+ 2203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.122783 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.122872 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:06.126578 (+ 3706us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:06.126584 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:06.126589 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:06.126626 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:06.129982 (+ 3356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:06.133201 (+ 3219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:06.133227 (+ 26us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:06.133230 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:06.133491 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:06.134122 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:06.134129 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:06.134154 (+ 25us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:06.134697 (+ 543us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:06.135078 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:06.136192 (+ 1114us) server_negotiation.cc:299] Negotiation successful
0619 06:44:06.136577 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260619 06:44:06.142846 1512 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a [term 1 FOLLOWER]: Refusing update from remote peer 1da52e8fb40b41b5b3d1dfe1aad6f65f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:44:06.144057 1570 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31fa95c56e3749588fadfef72f119e4a" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:44:06.144878 1540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:06.089946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49154 (local address 127.10.192.124:39285)
0619 06:44:06.090413 (+ 467us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.090421 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.116424 (+ 26003us) server_negotiation.cc:407] Connection header received
0619 06:44:06.116551 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.116557 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.116650 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.116742 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:06.119286 (+ 2544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.120332 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.123680 (+ 3348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.124372 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.124474 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:06.130536 (+ 6062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:06.130544 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:06.130551 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:06.130597 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:06.134663 (+ 4066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:06.136316 (+ 1653us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:06.136322 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:06.136325 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:06.136479 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:06.136931 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:06.136938 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:06.136943 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:06.137671 (+ 728us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:06.137949 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:06.143165 (+ 5216us) server_negotiation.cc:299] Negotiation successful
0619 06:44:06.143745 (+ 580us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":310}
I20260619 06:44:06.148614 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:06.094320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.10.192.124:39285 (local address 127.0.0.1:49170)
0619 06:44:06.094599 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0619 06:44:06.094624 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0619 06:44:06.094773 (+ 149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0619 06:44:06.106771 (+ 11998us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0619 06:44:06.106778 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0619 06:44:06.107347 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0619 06:44:06.107584 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:06.107597 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.118707 (+ 11110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.118713 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:06.120199 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0619 06:44:06.120214 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.122108 (+ 1894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.122114 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0619 06:44:06.122383 (+ 269us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:06.123099 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0619 06:44:06.123121 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0619 06:44:06.126116 (+ 2995us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0619 06:44:06.145571 (+ 19455us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:06.145590 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:06.145594 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:06.146186 (+ 592us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:06.146649 (+ 463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0619 06:44:06.146655 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0619 06:44:06.146658 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0619 06:44:06.146877 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0619 06:44:06.147535 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0619 06:44:06.147541 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0619 06:44:06.147757 (+ 216us) client_negotiation.cc:769] Sending connection context
0619 06:44:06.147897 (+ 140us) client_negotiation.cc:240] Negotiation successful
0619 06:44:06.148217 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141}
I20260619 06:44:06.149809 1582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:06.094400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49170 (local address 127.10.192.124:39285)
0619 06:44:06.106188 (+ 11788us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.106195 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.106229 (+ 34us) server_negotiation.cc:407] Connection header received
0619 06:44:06.106299 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.106304 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.106406 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.107819 (+ 1413us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:06.108156 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.116358 (+ 8202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.120400 (+ 4042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.121130 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.122761 (+ 1631us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:06.126375 (+ 3614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0619 06:44:06.126381 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0619 06:44:06.126386 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0619 06:44:06.126430 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0619 06:44:06.145367 (+ 18937us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:06.146306 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:06.146313 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:06.146319 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:06.146508 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0619 06:44:06.146991 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0619 06:44:06.146996 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0619 06:44:06.146999 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0619 06:44:06.147380 (+ 381us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0619 06:44:06.148987 (+ 1607us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:06.149121 (+ 134us) server_negotiation.cc:299] Negotiation successful
0619 06:44:06.149368 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11589,"thread_start_us":12137,"threads_started":1}
I20260619 06:44:06.155707 1463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995: Bootstrap starting.
I20260619 06:44:06.160367 1463 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995: Neither blocks nor log segments found. Creating new log.
I20260619 06:44:06.161753 1463 log.cc:824] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995: Log is configured to *not* fsync() on all Append() calls
I20260619 06:44:06.174247 1463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995: No bootstrap required, opened a new log
I20260619 06:44:06.186301 1545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1da52e8fb40b41b5b3d1dfe1aad6f65f. Latest consensus state: current_term: 1 leader_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } } peers { permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } } peers { permanent_uuid: "31fa95c56e3749588fadfef72f119e4a" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } } }
I20260619 06:44:06.186690 1545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:44:06.191411 1583 mvcc.cc:205] Tried to move back new op lower bound from 7298463523347947520 to 7298463523072733184. Current Snapshot: MvccSnapshot[applied={T|T < 7298463523347947520}]
I20260619 06:44:06.191843 1559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } } peers { permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } } peers { permanent_uuid: "31fa95c56e3749588fadfef72f119e4a" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } } }
I20260619 06:44:06.192162 1559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [sys.catalog]: This master's current role is: LEADER
I20260619 06:44:06.192925 1463 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } } peers { permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } } peers { permanent_uuid: "31fa95c56e3749588fadfef72f119e4a" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } }
I20260619 06:44:06.198529 1575 catalog_manager.cc:1347] Generated new cluster ID: c694e88766b048749962abdd1b155382
I20260619 06:44:06.198680 1575 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260619 06:44:06.204118 1545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } } peers { permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } } peers { permanent_uuid: "31fa95c56e3749588fadfef72f119e4a" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } } }
I20260619 06:44:06.204434 1545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:44:06.207824 1463 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bceddb4cfb2469fbb5db63b6ad55995, State: Initialized, Role: FOLLOWER
I20260619 06:44:06.208478 1463 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } } peers { permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } } peers { permanent_uuid: "31fa95c56e3749588fadfef72f119e4a" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } }
I20260619 06:44:06.217150 1589 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } } peers { permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } } peers { permanent_uuid: "31fa95c56e3749588fadfef72f119e4a" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } } }
I20260619 06:44:06.219853 1589 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:44:06.222097 1575 catalog_manager.cc:1370] Generated new certificate authority record
I20260619 06:44:06.222673 1463 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995 [sys.catalog]: configured and running, proceeding with master startup.
I20260619 06:44:06.222723 1438 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5bceddb4cfb2469fbb5db63b6ad55995"
I20260619 06:44:06.223240 1438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995 [term 0 FOLLOWER]: Advancing to term 1
I20260619 06:44:06.223999 1575 catalog_manager.cc:1504] Loading token signing keys...
I20260619 06:44:06.226850 1438 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1da52e8fb40b41b5b3d1dfe1aad6f65f in term 1.
I20260619 06:44:06.228360 1437 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995 [term 1 FOLLOWER]: Refusing update from remote peer 1da52e8fb40b41b5b3d1dfe1aad6f65f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260619 06:44:06.229426 1559 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260619 06:44:06.254951 1575 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f: Generated new TSK 0
I20260619 06:44:06.260823 1575 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260619 06:44:06.299719 1598 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } } peers { permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } } peers { permanent_uuid: "31fa95c56e3749588fadfef72f119e4a" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } } }
I20260619 06:44:06.300134 1598 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:44:06.300362 1570 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } } peers { permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } } peers { permanent_uuid: "31fa95c56e3749588fadfef72f119e4a" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } } }
I20260619 06:44:06.300662 1570 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1da52e8fb40b41b5b3d1dfe1aad6f65f [sys.catalog]: This master's current role is: LEADER
I20260619 06:44:06.300565 1589 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1da52e8fb40b41b5b3d1dfe1aad6f65f. Latest consensus state: current_term: 1 leader_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1da52e8fb40b41b5b3d1dfe1aad6f65f" member_type: VOTER last_known_addr { host: "127.10.192.126" port: 40891 } } peers { permanent_uuid: "5bceddb4cfb2469fbb5db63b6ad55995" member_type: VOTER last_known_addr { host: "127.10.192.125" port: 40315 } } peers { permanent_uuid: "31fa95c56e3749588fadfef72f119e4a" member_type: VOTER last_known_addr { host: "127.10.192.124" port: 39285 } } }
I20260619 06:44:06.300824 1589 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995 [sys.catalog]: This master's current role is: FOLLOWER
I20260619 06:44:06.344606 1606 catalog_manager.cc:1259] Loaded cluster ID: c694e88766b048749962abdd1b155382
I20260619 06:44:06.344795 1606 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995: loading cluster ID for follower catalog manager: success
I20260619 06:44:06.348614 1606 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995: acquiring CA information for follower catalog manager: success
I20260619 06:44:06.351071 1606 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5bceddb4cfb2469fbb5db63b6ad55995: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260619 06:44:06.423349 1542 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:06.402675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51120 (local address 127.10.192.126:40891)
0619 06:44:06.402945 (+ 270us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.402955 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.421216 (+ 18261us) server_negotiation.cc:407] Connection header received
0619 06:44:06.421565 (+ 349us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.421573 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.421667 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.421747 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:06.423069 (+ 1322us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51120: BlockingRecv error: recv got EOF from 127.0.0.1:51120 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260619 06:44:06.423368 1467 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:06.403004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47538 (local address 127.10.192.125:40315)
0619 06:44:06.403259 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.403266 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.421324 (+ 18058us) server_negotiation.cc:407] Connection header received
0619 06:44:06.421639 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.421646 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.421747 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.421830 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:06.423101 (+ 1271us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47538: BlockingRecv error: recv got EOF from 127.0.0.1:47538 (error 108)
Metrics: {"server-negotiator.queue_time_us":100}
W20260619 06:44:06.424988 1582 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:06.403354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49186 (local address 127.10.192.124:39285)
0619 06:44:06.403535 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.403544 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.421423 (+ 17879us) server_negotiation.cc:407] Connection header received
0619 06:44:06.423200 (+ 1777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.423207 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.423333 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.423414 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:06.424760 (+ 1346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49186: BlockingRecv error: recv got EOF from 127.0.0.1:49186 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260619 06:44:06.444128 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:06.428689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47546 (local address 127.10.192.125:40315)
0619 06:44:06.428880 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.428887 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.436219 (+ 7332us) server_negotiation.cc:407] Connection header received
0619 06:44:06.436512 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.436519 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.436722 (+ 203us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.436896 (+ 174us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:44:06.437710 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.438866 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.440957 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.441642 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.441761 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:06.442556 (+ 795us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:44:06.443259 (+ 703us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:44:06.443390 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:06.443667 (+ 277us) server_negotiation.cc:299] Negotiation successful
0619 06:44:06.443775 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260619 06:44:06.487529 1582 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:06.478069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49188 (local address 127.10.192.124:39285)
0619 06:44:06.478286 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.478293 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.485233 (+ 6940us) server_negotiation.cc:407] Connection header received
0619 06:44:06.485788 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.485796 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.485957 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.486035 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:06.487230 (+ 1195us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49188: BlockingRecv error: recv got EOF from 127.0.0.1:49188 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
I20260619 06:44:06.539798 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:06.521408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47560 (local address 127.10.192.125:40315)
0619 06:44:06.521640 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.521646 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.532711 (+ 11065us) server_negotiation.cc:407] Connection header received
0619 06:44:06.533235 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.533242 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.533361 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.533431 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:44:06.534133 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.535322 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.537425 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.538112 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.538215 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:06.538844 (+ 629us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:44:06.539035 (+ 191us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:44:06.539100 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:06.539331 (+ 231us) server_negotiation.cc:299] Negotiation successful
0619 06:44:06.539426 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260619 06:44:06.586287 1582 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:06.576566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49190 (local address 127.10.192.124:39285)
0619 06:44:06.576773 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.576779 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.583689 (+ 6910us) server_negotiation.cc:407] Connection header received
0619 06:44:06.584732 (+ 1043us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.584740 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.584860 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.584937 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:06.586014 (+ 1077us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49190: BlockingRecv error: recv got EOF from 127.0.0.1:49190 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260619 06:44:06.644304 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:06.626129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47574 (local address 127.10.192.125:40315)
0619 06:44:06.626307 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.626314 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.637068 (+ 10754us) server_negotiation.cc:407] Connection header received
0619 06:44:06.637627 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.637634 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.637732 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.637799 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:44:06.638539 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.639854 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.642008 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.642672 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.642766 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:06.643389 (+ 623us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:44:06.643535 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:44:06.643604 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:06.643867 (+ 263us) server_negotiation.cc:299] Negotiation successful
0619 06:44:06.643963 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260619 06:44:06.686802 1582 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:06.677636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49192 (local address 127.10.192.124:39285)
0619 06:44:06.677846 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.677853 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.684704 (+ 6851us) server_negotiation.cc:407] Connection header received
0619 06:44:06.685243 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.685250 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.685373 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.685515 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:06.686511 (+ 996us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49192: BlockingRecv error: recv got EOF from 127.0.0.1:49192 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
I20260619 06:44:06.701903 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:06.694178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47584 (local address 127.10.192.125:40315)
0619 06:44:06.694433 (+ 255us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.694440 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.695041 (+ 601us) server_negotiation.cc:407] Connection header received
0619 06:44:06.695246 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.695253 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.695389 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.695516 (+ 127us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:44:06.696036 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.697261 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.699314 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.700195 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.700349 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:06.700857 (+ 508us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:44:06.701052 (+ 195us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:44:06.701168 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:06.701425 (+ 257us) server_negotiation.cc:299] Negotiation successful
0619 06:44:06.701522 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
W20260619 06:44:06.716889 1582 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:06.714072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49196 (local address 127.10.192.124:39285)
0619 06:44:06.714333 (+ 261us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.714339 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.715213 (+ 874us) server_negotiation.cc:407] Connection header received
0619 06:44:06.715430 (+ 217us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.715438 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.715538 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.715671 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:06.716629 (+ 958us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49196: BlockingRecv error: recv got EOF from 127.0.0.1:49196 (error 108)
Metrics: {"server-negotiator.queue_time_us":123}
I20260619 06:44:06.736006 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:06.728640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47594 (local address 127.10.192.125:40315)
0619 06:44:06.728912 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.728919 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.729179 (+ 260us) server_negotiation.cc:407] Connection header received
0619 06:44:06.729444 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.729450 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.729549 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.729652 (+ 103us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:44:06.730204 (+ 552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.731428 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.733691 (+ 2263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.734400 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.734530 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:06.735107 (+ 577us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:44:06.735259 (+ 152us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:44:06.735369 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:06.735564 (+ 195us) server_negotiation.cc:299] Negotiation successful
0619 06:44:06.735680 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
W20260619 06:44:06.757104 1582 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:06.753547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49204 (local address 127.10.192.124:39285)
0619 06:44:06.753717 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.753722 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.755093 (+ 1371us) server_negotiation.cc:407] Connection header received
0619 06:44:06.755567 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.755573 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.755692 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.755800 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:06.756742 (+ 942us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49204: BlockingRecv error: recv got EOF from 127.0.0.1:49204 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
I20260619 06:44:06.785640 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:06.777962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47602 (local address 127.10.192.125:40315)
0619 06:44:06.778184 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.778191 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.778813 (+ 622us) server_negotiation.cc:407] Connection header received
0619 06:44:06.779070 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.779077 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.779181 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.779283 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:44:06.779898 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.781116 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.783270 (+ 2154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.784002 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.784143 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:06.784772 (+ 629us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:44:06.784944 (+ 172us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:44:06.785027 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:06.785212 (+ 185us) server_negotiation.cc:299] Negotiation successful
0619 06:44:06.785317 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
W20260619 06:44:06.796263 1582 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:06.793759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49208 (local address 127.10.192.124:39285)
0619 06:44:06.793967 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.793974 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.794594 (+ 620us) server_negotiation.cc:407] Connection header received
0619 06:44:06.794853 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.794859 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.794966 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.795078 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:06.796022 (+ 944us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49208: BlockingRecv error: recv got EOF from 127.0.0.1:49208 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
I20260619 06:44:06.839731 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:06.832142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47610 (local address 127.10.192.125:40315)
0619 06:44:06.832441 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.832448 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.832726 (+ 278us) server_negotiation.cc:407] Connection header received
0619 06:44:06.833063 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.833070 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.833180 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.833295 (+ 115us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:44:06.833800 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.834971 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.837093 (+ 2122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.837852 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.838000 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:06.838582 (+ 582us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:44:06.838741 (+ 159us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:44:06.838866 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:06.839038 (+ 172us) server_negotiation.cc:299] Negotiation successful
0619 06:44:06.839139 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
W20260619 06:44:06.849807 1582 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:06.847069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49210 (local address 127.10.192.124:39285)
0619 06:44:06.847318 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.847329 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.847777 (+ 448us) server_negotiation.cc:407] Connection header received
0619 06:44:06.848113 (+ 336us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.848120 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.848217 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.848295 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:06.849489 (+ 1194us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49210: BlockingRecv error: recv got EOF from 127.0.0.1:49210 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
I20260619 06:44:06.924484 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:06.918400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47622 (local address 127.10.192.125:40315)
0619 06:44:06.918638 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.918645 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.918986 (+ 341us) server_negotiation.cc:407] Connection header received
0619 06:44:06.919218 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.919224 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.919317 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.919423 (+ 106us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:44:06.919951 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.921020 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.922568 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:06.923066 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:06.923213 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:06.923710 (+ 497us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:44:06.923841 (+ 131us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:44:06.923944 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:06.924090 (+ 146us) server_negotiation.cc:299] Negotiation successful
0619 06:44:06.924181 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
W20260619 06:44:06.933777 1582 negotiation.cc:337] Failed RPC negotiation. Trace:
0619 06:44:06.931875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49220 (local address 127.10.192.124:39285)
0619 06:44:06.932075 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:06.932082 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:06.932438 (+ 356us) server_negotiation.cc:407] Connection header received
0619 06:44:06.932600 (+ 162us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:06.932606 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:06.932705 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:06.932833 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0619 06:44:06.933553 (+ 720us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49220: BlockingRecv error: recv got EOF from 127.0.0.1:49220 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260619 06:44:06.988938 1556 catalog_manager.cc:1259] Loaded cluster ID: c694e88766b048749962abdd1b155382
I20260619 06:44:06.989044 1556 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a: loading cluster ID for follower catalog manager: success
I20260619 06:44:06.991755 1556 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a: acquiring CA information for follower catalog manager: success
I20260619 06:44:06.993680 1556 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 31fa95c56e3749588fadfef72f119e4a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260619 06:44:07.072553 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:07.067250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47634 (local address 127.10.192.125:40315)
0619 06:44:07.067500 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:07.067506 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:07.067819 (+ 313us) server_negotiation.cc:407] Connection header received
0619 06:44:07.067985 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:07.067989 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:07.068061 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:07.068142 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:44:07.068531 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:07.069263 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:07.070643 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:07.071077 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:07.071182 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:07.071718 (+ 536us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:44:07.071850 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:44:07.071930 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:07.072080 (+ 150us) server_negotiation.cc:299] Negotiation successful
0619 06:44:07.072149 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260619 06:44:07.084755 1582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:07.078895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49234 (local address 127.10.192.124:39285)
0619 06:44:07.079132 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:07.079141 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:07.079421 (+ 280us) server_negotiation.cc:407] Connection header received
0619 06:44:07.079666 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:07.079673 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:07.079847 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:07.079977 (+ 130us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:44:07.080389 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:07.081078 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:07.082426 (+ 1348us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:07.082880 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:07.083019 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:07.083526 (+ 507us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:44:07.084139 (+ 613us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:44:07.084319 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:07.084371 (+ 52us) server_negotiation.cc:299] Negotiation successful
0619 06:44:07.084456 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260619 06:44:07.104027 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:07.091719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47650 (local address 127.10.192.125:40315)
0619 06:44:07.091954 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:07.091963 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:07.096327 (+ 4364us) server_negotiation.cc:407] Connection header received
0619 06:44:07.096849 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:07.096857 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:07.096961 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:07.097041 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:44:07.098113 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:07.099204 (+ 1091us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:07.101317 (+ 2113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:07.102137 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:07.102303 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:07.103126 (+ 823us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:44:07.103277 (+ 151us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:44:07.103344 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:07.103609 (+ 265us) server_negotiation.cc:299] Negotiation successful
0619 06:44:07.103749 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260619 06:44:07.104794 1582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:07.091361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49242 (local address 127.10.192.124:39285)
0619 06:44:07.091922 (+ 561us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:07.091933 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:07.096730 (+ 4797us) server_negotiation.cc:407] Connection header received
0619 06:44:07.097027 (+ 297us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:07.097031 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:07.097137 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:07.097249 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:44:07.097794 (+ 545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:07.098630 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:07.101428 (+ 2798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:07.102169 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:07.102303 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:07.103112 (+ 809us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:44:07.103278 (+ 166us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:44:07.103343 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:07.104333 (+ 990us) server_negotiation.cc:299] Negotiation successful
0619 06:44:07.104491 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260619 06:44:07.105628 1711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0619 06:44:07.091144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51136 (local address 127.10.192.126:40891)
0619 06:44:07.095436 (+ 4292us) server_negotiation.cc:206] Beginning negotiation
0619 06:44:07.095447 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0619 06:44:07.095963 (+ 516us) server_negotiation.cc:407] Connection header received
0619 06:44:07.096248 (+ 285us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0619 06:44:07.096257 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0619 06:44:07.096506 (+ 249us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0619 06:44:07.096727 (+ 221us) server_negotiation.cc:226] Negotiated authn=TOKEN
0619 06:44:07.097358 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:07.098750 (+ 1392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:07.102432 (+ 3682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0619 06:44:07.102876 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0619 06:44:07.103048 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0619 06:44:07.103631 (+ 583us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0619 06:44:07.104239 (+ 608us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0619 06:44:07.104367 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0619 06:44:07.105167 (+ 800us) server_negotiation.cc:299] Negotiation successful
0619 06:44:07.105283 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4104,"thread_start_us":3947,"threads_started":1}
I20260619 06:44:07.110580 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 1322
I20260619 06:44:07.112352 1384 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:44:07.227005 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 1322
W20260619 06:44:07.247776 1415 connection.cc:535] server connection from 127.0.0.1:47500 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260619 06:44:07.248282 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 1396
I20260619 06:44:07.249382 1458 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:44:07.358384 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 1396
I20260619 06:44:07.379145 11009 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskx_grPe/build/asan/bin/kudu pid 1470
I20260619 06:44:07.380358 1532 generic_service.cc:196] Checking for leaks (request via RPC)
I20260619 06:44:07.489638 11009 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskx_grPe/build/asan/bin/kudu with pid 1470
2026-06-19T06:44:07Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (4484 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (9415 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (366882 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST